AD-751  487 

DEVELOPMENT  OF  MOTIVATION  ASSESSMENT 
TECHNIQUES  FOR  AIR  FORCE  OFFICER  TRAINING 
AND  EDUCATION  PROGRAMS:  MOTIVATION  FOR 
PILOT  TRAINING 

Calvin  W.  Taylor,  et  al 

Utah  University 


Prepared  for: 

Air  Force  Haman  Resources  Laboiatory 


July  1971 


DISTRIBUTED  BY: 


Natjonl  Teciinical  InfcnutiOR  Service 
U.  $.  DEPARTMENT  OF  COMMERCE 

b2B5  Port  Rcya!  Road,  Springfield  Va.  22151 


NOTICE 


When  US  Govenunent  dtzwings,  specifications,  or  other  data  are  used 
for  any  purpose  other  than  a  definitely  related  Government 
procurement  operation,  the  Government  thereby  incurs  no 
re^onsfbflity  nor  any  obligation  wdiatsoever,  and  the  fact  that  the 
GovemiiKnt  may  have  formulated,  futni^ed,  or  in  any  v/ay  sup{died 
the  said  drawings,  ^recifications.  or  other  data  is  not  to  be  regarded  by 
implication  or  otherwis.:,  as  in  any  manner  iicen^g  the  header  or  any 
other  person  or  corporation,  or  conveying  any  ri^ts  or  permission  to 
manufacture,  use,  or  sell  any  patented  invention  that  may  in  any  way 
be  related  thereto. 


f.T 

- — I 

nis 

r : 

M  : 

.:..J  □ 

BS' 

n 

K'..u. 

ir 

i;K'5.':?il33  'A»IIUIUTT  CSBB  j 

ic.. 

A./IL  Vj 

w  jfiCiU 

nwtivation 
personnel  sdection 
training 
education 


Undassilied 


DOCUMENT  CONTROL  DATA  -  R  &  D 

^^^^^^(5^et»it)^i**tttiC9tioa9ttltt0^bo£yofMbstrmc^tnCindtMin^sMotMticnaus^^e9nter*dh0^ 

u^Rt^HATtHC  Acrtvtry  (C^rpotmtm  muthoe)  -  -  l2#.  ^po«t  stCUR* class. pication 


University  of  Utah 

Unclassified 

Salt  Lake  Dty,  Utah 

2b.  CROUP 

1).  REPORT  TITLE 

DEVELOPMENT  OF  MOTiVATION  ASSESSMENT  TECHNIQUES  FOR  AIR  FORCE 
OFFICER  training  AND  EDUCATION  PROGRAMS:  MOTIVATION  FOR  PILOT  TRAINING 


4.  OESCAiPTive  NOTES  (Tyf*^  oi  report  ortd  in^'turire  deter) 


9-  AUTHOPISI  (Firet  nmme^  Twiddle  initiels  /4«fn«a»e^ 

Calvin  W.  Taylor  Melvin  S.  Majesty 

Stephen  L.  Murray 
Robert  L  Ellison 


«.  REPORT  DATE 

July  1971 

IgUg^lllligil 

76.  NO.  OP  REPS 

73 

•a.  contract  or  grant  no. 

F33615.69C-I882 

6.  PBOJSCTNO.  1125 

yu.  ORtClNAy6R*S  REPORT  NUU8CR(S) 

AFHRL-TR-71-21 

c.  Task  No.  IJ  2501 

eb.  OTHER  REPORT  NO(S)  (Afty  ether  nvmb^rx  thot  moy"  be  ortiined 
thie  report^ 

d.  WoricUnitNo.  11250101 

10.  OISTRieuTlON  STATCMCNr 


Approved  for  public  release;  distiibuticn  unlimited. 


11.  supplCmentart  notes 

12.  SPONtORfNC  MILITARY  ACTtViTV 

Air  Force  Human  Resources  Laboratory 

Professional  Education  Division 

Brooks  Air  .Porcc  Base,  Texas 

13.  AOSTRACT 


TIbs  study  was  an  investigation  into  the  relevance  ''f  ;.ioavationa]  factors  ope^ting  i.i  various  Air  Force 
training  programs,  especially  Air  Training  Comm^iiu  s  Undergraduate  IMot  Training  program.  The  research  project, 
as  a  wh(^,  was  directed  toward  understa..ding  n^rtivational  factors  as  they  distinguish  those  who  drop  out  of 
training  from  those  who  successfully  complete  training.  Investigation  of  vhe  possiUe  motivational  factors  behind 
voluntary  elimirution  was  designed  to  lead  to  (a)  the  develoitment  of  a  motivational  screening  device  whidi  would 
reduce  the  vduntaiy  eliminees  from  Undergraduate  Pdot  Training's  wd!  as  other  Air  Force  trailing  programs:  and 
(b)  the  development  of  an  instrument  whxh  would  measure  change  in  motivation  as  a  result  of  .^tr  Force  training. 
Th'S  rcp<^  serves  to  specify  the  overall  project  research  design  and  to  report  results  and  conclusions  reached  in  the 
first  year  of  data  coDcction.  Two  of  tfjc  most  interesting  findings  at  this  early  stage  of  development  are  that  some 
motivational  component  exists  in  both  the  self-initbted  elimination  (SIE)  attrition  criteria  and  the  keys  buSt  to 
predict  them,  and,  further,  that  the  AFOQT  already  contains  valid  items  tluit  are  not  now  being  used  but  which  can 
be  scored  for  motivational  screening  purposes.  Althou^  the  AFOQT  is  not  now  being  scored  for  motivation,  th..e 
seems  to  exist  a  potendal  for  increased  efficiency  of  predicting  Self-lrjtiated  Elimination  (SIE).  Empirkd  keying  of 
AFOQT  items  and  the  most  vah'd  items  developed  in  this  study  yielded  promisme  results  as  a  first  step  in  the 
development  of  a  motivation  assessment  tedinique.  It  is  recommended  that  further  research  be  done  to  more  fully 
assess  the  impact  of  this  initial  investigation. 


DD 


FORM 

1  NOV  45 


1473 


Unclassified _ 

S<*cunr’  Classification 


r 

£ 


AFHRL-TR-71-21 


motivation  assessment  techniques  for  air  force 
r-.  FICEB  TRAINING  AND  EDUCATION  PROGRAMS:  MOTIVATIMEOT  pTct™a|NING 


Calvin  W.  Taylor 
Stephen  L.  Murray 
Robert  L.  Ellison 

Univcnity  of  Utah 

MeNin  S.  M^esty,  Lt  Col.,  USAF 


Approved  for  public  rrtcase;  distribution  unlimited. 


professions  1.  EDUCATION  DIVISION 
AIR  FORCE  human  RESOURCES  LABORATORY 
AIR  FORCE  SYSTEMS  COMMAND 
Brooks  Air  Force  Sese,  Texas 


iii 


FOREWORD 


This  study  represents  a  portion  of  the  exploratory  development  program  of  he 
Professional  Education  Division,  Air  Force  Human  Resources  Laboratory  (AFHP  L), 
Brooks  Air  Force  Base,  Tenas.  This  report  covers  part  of  the  research  conducted  by  he 
University  of  Utali,  Salt  Like  City,  Utah,  under  Contract  Number  F  33615-69-C*18  i2. 
The  rfi'iearch  work  unit  HkSQlOl,  Meanrrement  of  Motivation  in  Air  Force  Offi:er 
Training  and  Education,  is  documented  under  Task  1 1 2501,  Self-Initiated  Eliminatim, 
Idotivation  Engineering  and  the  Zero  Draft  Force,  of  Project  1 125,  Air  Force  Professional 
Education. 

Tins  motivation  effort  is  in  direct  support  of  several  Hq  USAF  Requests  for 
Education  and  Training  Research  (RER/RTR)  and  the  Hq  USAF  Personnel  Plan  in  the 
Motivation  area.  The  initial  request  from  Hq  Air  Training  Command  was  as  follows: 
“Identify  the  motivational  factors  operating  on  Undergraduate  Pilot  Training  (UPT) 
students  and  determine  UkC  influence  such  factors  have  on  performance  and  elimination.” 
The  initial  investigation  identiPied  the  irritants  and  motivators  in  UPT  (AFHRL-TR-69-3, 
Motivation  Fingineering  for  Pilot  Training,  and  Air  Force  Film  Report  SPR  6-70, 
Motivation  Engineering  for  VPT).  Prior  to  completion  of  the  initial  investigation,  Hq  ATC 
specifically  defined  the  motivation  problem  as  self-initiated  elimination  (SIE)  from  flying 
training  and  requested  that  a  screening  instrument  be  developed. 

The  current  effort  is  in  direct  response  to  tlte  request  for  a  motivation  screening 
instrument.  During  the  course  of  the  study,  in-process  reviews  were  provided  to  Hq 
USAF,  Hq  AFSC,  and  Hq  ATC.  The  work  unit  was  briefed  to  the  Scientific  Advisory 
Board  and  at  all  AFMRL  Program  Review  presentations. 

Dr.  Calvin  W.  Taylor.  Professor  of  Psychology  at  the  University  of  Utali,  was  tlte 
principal  investigator.  Dr.  Robert  Ellison,  Institute  for  Behavioral  Research  In  Creativity, 
was  the  co-principal  investigator.  Dr.  Stephen  Murray,  Dr.  Larry  James,  Mr.  David  I'ox, 
and  Mr.  David  Nelson  from  the  University  of  Utah  assisted  for  this  portion  of  the  project. 
Dr.  Melvin  S.  Majesty,  Professional  Education  Division,  AFHRL,  was  the  project  scientist. 
The  report  was  submitted  by  the  authors  in  June  1971. 

This  technical  report  had  been  reviewed  and  is  approved. 

George  K.  Patterson,  Colonel,  USAF 
Commander 
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SUMMARY 


Taylor..  C.W.,  Murray,  S.L.,  EMisoti.  R.L.,  &  Msiesty,  MS.  Development  of  motivation  assessment 
techniques  for  Air  Force  officer  trainmg  and  education  proirams:  Motivudon  for  pilot  training. 
AFHRL-TR-71-21.  Brooks  AFB,  Tex.:  Proibsdonal  Education  Division,  Air  Force  Human  Resources 
laboratoiy,  July  1971. 

Probteffl 

Individuals  vvho  are  selected  for  Undergraduate  Pilot  Training  (UPT)  have  undergone  very  intsnsve 
administrative  physied  and  aptitude  screening.  They  are  a  highly  selected  group  of  college  graduates  and 
commissioned  officers.  Even  though  the  screening  is  thorouglr,  the  overall  attrition  in  UPT  is  around  25 
percent;  that  is,  one  out  of  every  four  individuals  who  are  selected  to  enter  UPT  ful  to  cmnplete  the 
program.  The  Mr  Training  Command  (ATC)  wanted  to  obtain  a  better  understanding  of  motivation  in 
flying  training.  The  motivatiem  problem  was  speciflcally  defined  as  Self-Initiated  EUmhution  (SIE).  ATC 
requested  the  development  of  a  screening  instrument  that  would  screen  out  those  Individuals  whose 
motivation  configuration  make  it  unlikely  that  they  would  cmnplete  the  UPT  program.  Although  die  SIE 
rate  is  not  excessively  high,  it  had  been  increaang  in  both  UI^  and  Undergraduate  Navigator  Training 
(UNT).  In  addition,  there  is  every  reason  to  su^ct  that  the  largest  UPT  attrition  category,  flying 
deficiency,  has  a  motivational  component. 


Approadi 

The  exploratory  development  effort  encompasses  the  assessment  of  motivation  in  officer  education 
and  tiding  programs.  Of  primary  concern  are  the  officer  commissioning  programs-Olficer  Training 
School  (OTS),  Reserve  Officer  Training  Corps  (ROTC),  and  USAF  Acaden^  (AFA)-whidi  are  the 
principal  sources  for  the  UPT  program.  The  initial  emphasis  is  upon  the  assessment  of  motivation  for  pilot 
trrunmg  and  concentrates  on  cne  of  the  largest  input  sources,  OTS.  The  effort  focused  on  the  development 
of  a  special  motivation  assessment  instrument  to  predict  SIE.  The  technique  was  primarily  that  of 
biographical  information,  or  standardized  interview,  in  the  form  of  a  Flying  Training  Survey  questionnaire. 
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Results 

Even  though  the  individuals  in  UPT  arc  a  highly  selected  group,  making  it  extremely  difficult  to  show 
further  differences  among  them,  the  motivation  assessment  instrument  was  able  to  demonstrate  significant 
differences.  Two  interesting  findings  resulted  from  the  first  year  of  the  investigation: 

1.  Tne  motivation  screening  instrument  predicts  SIE  from  UPT  better  than  the  Pilot  Composite  of 
the  Air  Force  Officer  Qualifying  Test  (AFOQT)  predicts  other  flying  deficiency  elimination  or  SIE. 

2.  The  AFOQT  already  contains  valid  items  that  arc  not  now  being  used,  but  vhich  can  be  scored, 
for  motivation  screening  purposes. 

CenclusioRS 

The  Air  Fores  has  a  lot  of  information  on  what  pilots  can  do,  but  it  lacks  systematic  data  on  what 
pilots  will  do.  Certainty  the  dimcnsioiis  of  motivation  are  not  nearly  as  well  defined  or  studied  as  aptitudes, 
skills,  knowledges,  and  intellectual  talents.  This  effort  sic?ws  very  significant  progress  in  terms  of  predicting 
what  people  will  do.  The  first  step  in  the  dcvelopme:.-!  or'  a  technique  for  assessing  motivation  for  pilot 
trair’ing  has  been  successfully  completed.  Early  analy:^  onsed  on  about  one-fifth  of  all  the  individuals  for 
wdiom  data  will  be  available,  had  resulted  in  the  first  revisiot:  of  the  motivation  screening  instrument.  Data 
are  now  being  coilecteu  with  the  revised  instrument.  Since  cacn  graduate  from  UPT  costs  approximately 
$82,640,  there  arc  sizeable  savings  to  be  gained  from  a  motivation  screening  instrument  that  will  increase  an 
individual's  chairccs  of  completing  UPT  Although  the  SIE  is  a  highly  restricted  operational  definition  of 
motivation,  the  ability  to  predict  this  criterion  provides  a  definite  indication  that  motivation  is  being 
assessed  by  this  now  instrument.  Howevci’.  the  greatest  potential  and  payoff  for  the  instrument  is  beyond 
the  limited  SiF.  criterion  to  the  assessment  of  motivation  for  pilot  training.  For  example,  the  motivational 
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component  of  other  attrition  categories,  such  as  flying  deficiency,  increases  the  operational  utilit>'  of  a 
motivation  screening  device.  A.*:  the  Air  Force  moves  toward  a  zeronlraft  environment  with  concomitant 
liighly  desirable  pay  scales,  a  rnnHaation  assessment  instnurtent  wiO  be  able  to  identify  the  apjdicant  who  is 
motivated  for  ffying  as  '.pposed  ro  those  who  are  attracted  to  the  Air  Force  for  other  reasons  sudi  as 
money  and  national  u.‘.,ii,">loyment  levels.  With  an  all-volunteer  force,  motivation  wiO  become  just  as 
important  (if  not  moi?^ .  >  portant)  than  aptitudes  and  intellectual  talents.  In  fact,  under  these  conditioiis, 
motivation  h  cr  ihe  greatest  potential  as  best  single  predictor  of  success  in  Air  Force  officer  education  and 
training  programs. 


Keiv^nunendatioM 


Although  the  AFOQT  is  not  now  being  scored  for  motivat  on,  there  seems  to  exist  a  p.otential  for 
increased  cfiicienf^  of  predicting  Self-Inithted  Biminatiou  (SIE).  Empirical  keying  of  AFCX^  items  and 
the  mos*  valid  items  developed  in  this  study  yielded  promising  results  as  a  first  step  in  the  development  of  a 
:t>tivati  '-n  asst  rsment  tedin'tpie.  It  is  reemnmended  that  further  research  be  dene  to  more  fully  assess  the 
. .  -pact  of  d<  J  h*!  'ial  investigation. 
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DEVELOPMENT  OF  MOTIVATION  ASSESSMENT  TECHNIQUES  FOR  AIR  FORCE 
OFHCER  TRAINING  AND  EDUCATION  PROGRAMS;  MOTIVATION  FOR  HLOT  TRAINING 


L  INTRODUCTION 


0\’er  the  years  extensive  attention  has  been 
^ven  by  the  mOitaiy  services  and  the  Air  Fcxce 
Human  Resources  Laboratory  to  topics  of  officer 
selection,  motivation,  self-initiated  elimination 
from  flying  training  programs,  and  use  of  bio¬ 
graphic^  data  (Majesty,  1967).  Tediniques  for 
selecting  offlcers  for  Air  Force'  prr^ams  have  been 
developed  throu^  various  research  studies  (Tupes 
&  Christal,  1957).  Most  of  this  resear<^  has 
addressed  motivation  either  directly  or  indirectly 
(Bowles  &  Torr.  1955;  Creager,  1957;  Darky  & 
Gragg,  1949;  Flyer,  1956;  Flyer  &  ?;gbse,  1955; 
Flyer  &.  Carp,  1957;  Iverson,  1955;  Iverson  & 
Preston.  1955;  Iverson  Sc.  Tomlrssrm,  1956;  Torr. 
1953;  Tupes,  1955;  Tupes,  Bowks,  &  Torr,  1955; 
Tupes,  Carp,  Sc.  Borg,  1957;  Tupes  Sc.  Cox  1951; 
and  Vakntine,  1958).  The  principal  recommenda¬ 
tion  resulting  from  the  earlier  research  studies  was 
that,  as  appropriate  motivation  measures  are 
developed,  consideration  should  be  given  to  the 
inclusion  of  motivation  assessment  in  offlcer 
selection  and  classification  test  batteries  (Tupes  Sc. 
Christa],  1957). 


Ihis  exploratory  development  effort  encom¬ 
passes  the  assessment  of  motivation  in  ofltcer 
education  and  trying  programs.  Of  primary 
concern  are  the  offlcer  commissionu:3  programs- 
Offker  Training  School  (OTS),  Reserve  Officer 
Training  Corps  (ROTC),  and  United  States  Air 
Force  Academy  (AFA)-which  are  the  ptitKipal 
sources  for  the  Undergraduate  Pilot  Training 
(UPT)  program.  Tiie  initial  emphass  is  upon  the 
development  of  a  motivatirm  screening  technique 
to  assess  motivatiem  for  pilot  training. 

Pilot  training  is  the  most  costly  type  of  indi¬ 
vidual  training  given  by  any  of  the  services;  it  is 
probrdrly  the  most  expend  educatkxul  process 
in  the  world.  In  recent  years,  the  bfll  for  pflot 
training  for  the  military  services-Atmy,  Navy,  Air 
Force,  and  Marine  Corps-xnounted  to  over  two 
billion  dollars  a  year.  In  a  program  of  such 
flnanda]  magnitu^,  even  margrnal  economies 
result  in  sizeable  savings. 


Althou^  the  cost  of  the  Air  Force's  Under¬ 
graduate  Pilot  Training  program  depends  upon 
what  costs  are  included,  or  excluded,  the  cost  per 
graduate  has  been  placed  at  $82,640  during  a 
House  Appropriations  Committee  hearing  on  the 
Air  Force’s  operations  and  maintenance  budget. 


Statement  of  the  Problem 


Of  the  three  principal  sources  of  entry  into 
UPT,  OTS  alone  receives  about  30,000  applicants 
aruiuaDy  (Cook,  1969).  individuals  who  are  finally 
selected  for  UPT  have  undergone  intensive 
physical  and  aptitude  screening.  Even  th  the 
screening  is  very  thorou^,  the  overall  att:  ion  in- 
UPT  is  around  25  percenl-that  is,  one  out  of 
every  four  individuals  who  enter  pilot  training  fail 
to  complete  the  program.  For  example,  in  fiscal 
year  1969,  the  elimination  was  1,111  officers,  or 
nearly  26  percent  of  the  4319  officers  sent  to 
UPT.  However,  washouts  from  the  OTS  source  of 
entry  into  UPT  were  637  of  the  1,111  officers 
attrited,  or  5?  percent 


In  order  to  obtain  a  better  understanding  of  the 
role  of  motivation  in  flying  training,  the  Air  Train¬ 
ing  Command  requested  that  Air  Force  Human 
Resources  Laboratory  identify  the  motivational 
factors  operating  on  UPT  students  and  determine 
the  influence  such  factors  have  on  performance 
and  elimination.  The  investigation  began  with  a 
systematic  identification  of  the  motivational 
factors  (grating  in  UPT.  Both  the  irritants  and 
motivators  in  UPT  were  identified  (Herzbeig, 
Winslow,  Sc.  Majesty.  1%9).  The  interpretation  and 
implication  of  the  findings  were  presented  in  an 
Air  Force  Fflm  Report,  SPR  6-70,  Motivation 
Engneering  for  UPT.  Before  the  initial  investiga¬ 
tion  could  be  completed,  the  Air  Training 
Command  specifically  defined  the  motivation 
problem  as  self-initiated  elimination  (SIE)  from 
flying  training  and  requested  that  a  screening 
instrument  be  developed.  Although  the  SIE  rate  is 
not  excesavdy  high,  it  had  been  increasing  in  both 
UPT  and  Undergraduate  Navigator  Training 
(UNT).  Furthermore,  there  is  every  reason  to 
suspect  that  the  largest  UPT  attrition  category, 
flying  defickney,  had  a  motivational  component. 


The  effort  to  develop  a  motivation  screening 
instrument  began  with  UPT  and  concentrated  on 
one  of  the  largest  input  sources.  Officer  Training 
School  (OTS). 

Of  the  available  attrition  categories,  u  ••  S»-lf- 
Initialed  Elimination  was  considered  to  be  an 
important  indicator  of  a  student’s  motivational 
deficiency.  SIE,  or  voluntary  eliminatirn,  is  one  of 
a  set  of  classifications  used  to  describe  the  circum¬ 
stances  under  which  a  student  may  leave  training. 
Since  the  SIE  category  is  the  direct  result  of  a 
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request  from  the  student,  it  appears  to  have 
obvious  motivational  relevance.  The  actud 
responsibility  for  action  is  the  student’s  rather 
than  some  superior’s.  The  locus  of  this  initial 
decision  provides  the  basis  for  the  assumption  that 
those  who  voluntarily  resign  lack  the  necessary 
motivational  or  attitudinal  qualities  needed  to 
complete  trainuig. 

Motivation  has  been  an  eluwe  concept  in  tenm: 
of  defining  essential  characteristics  and  accom¬ 
plishing  their  measurement.  Despite  exten^e 
theoretical  statements,  expenmental  investiga¬ 
tions,  and  measurement  attempts,  little  practical 
progress  has  besn  made  in  predicting  important 
aspects  of  human  behavior  through  the  use  of 
measured  motivational  attributes.  The  stand¬ 
ardized  tests  designed  to  measure  motivation  per 
se  would  be  of  unknown  value  for  predicting  an 
31E  measure  because  motivation  is  such  a  complex 
and  at  times  vague  phenomenon  at  our  present 
state  of  knowledge.  Certainly  the  dimensionality 
of  motivational  characteristics  is  not  nearly  so  well 
defined  or  studied  as  is  the  dimendonality  of 
intellectual  talents. 

Approadi  to  the  Problem 

One  psychological  measurement  technique 
whidi  has  had  great  success  in  a  number  of  areas 
and  which  can  involve  motivational  ccmiponents  is 
the  biographical  information  approach.  Biograph¬ 
ical  information  refers  to  a  collection  of  multiple 
choice  questions  in  which  an  individual  describes 
himself  and  his  background;  some  of  the  questions 
are  similar  to  those  found  on  an  application  blank. 
The  rationale  in  u^g  such  an  approach  is  very 
ample-that  past  behavior  and  sclf-perceptiuns  can 
be  used  as  an  indicator  of  future  behavior. 

The  biographical  conelates  of  talent  and 
achievement,  or  what  might  be  better  termed  the 
non-intellectual  measures  of  performance,  cover  an 
area  of  research  that  has  been  g>-owjng  rapidly 
during  the  past  10  years  through  the  increased 
availability  and  capability  of  high-^>ecd  com¬ 
puters.  Since  the  biograihical  approach  typically 
involves  a  wide  variety  of  heterogeneous  items,  it 
has  been  used  to  identify  a  wide  variety  of  difller- 
ent  kinds  of  potential  capabilities  including 
successful  performance  among  scientists,  execu¬ 
tives,  nurses,  graduate  students,  and  army  ofTiccrs. 
In  many  of  these  snidks,  the  criterion  measures  of 
performance  have  been  relatively  impervious  to 
prediction  by  other  kinds  of  selection  devices  such 
as  aptihide,  achievement,  or  personality  tests. 

The  main  focus  of  the  present  shidy  is  to 
exantine  the  effectiveness  of  a  specially  devclt^cd 
Biographical  Invcntoiy  (BI)  to  predict  voluntaiy 


elimination  from  UPT,  hereafter  labeled  UPT-SIE. 
Contingent  upon  successful  results  in  predicting 
UPT-SIE,  the  scope  of  the  research  will  be 
expanded  to  indude  the  prediction  of  motiva¬ 
tional  criteria  in  ether  Air  Force  training  pro¬ 
grams.  The  degree  to  which  the  motivatimal  and 
other  components  undedying  the  SIE  category  arc 
general  or  specific  to  the  SIE-derived  criteria  could 
be  examined  by  testing  the  extent  to  which  the 
results  generalize  to  other  important  criteria  with 
assumed  motivat^..nal  compements. 

The  additional  Air  Force  training  programs 
which  would  be  subject  to  indudon  are  Officer 
Training  School,  Undergraduate  Navigator 
Training,  and  Undeigraduate  Helicopter  Training. 
The  latter  two  programs  along  with  UPT  arc 
advanced  flying  training  programs  which  may  be 
entered  from  a  number  of  sources,  two  of  which 
are  Officer  Training  School  and  Air  Force  Reserve 
Officer  Training  Corps.  Eadi  of  these  additional 
training  programs  has  a  voluntary  elimination 
category  and  other  elimination  categories,  some  of 
which  parallel  those  in  UPT. 

There  are  some  predictable  diflierences  in  over¬ 
all  elimination  rates  for  students  who  enter  flying 
training  programs  from  the  diflerent  source 
programs.  The  smallest  percentage  of  v/adiouts  in 
UPT  is  among  tliose  from  the  Air  Force  Academy, 
while  the  largest  percentage  is  from  OTS.  The 
magnitude  of  the  problcir.  of  voluntary  elimina¬ 
tion  from  UPT  is  much  greater  for  those  who  enter 
from  OTS  than  for  those  who  enter  through  any 
other  training  program.  Consequently,  the  major 
effort  of  the  project  is  concern^  with  attempting 
to  predict  which  UPT  students  who  entered  from 
OTS  would  be  likely  to  become  self-initiated  clim- 
inecs. 

The  research  was  jdaimed  to  indude  three 
interdependent  phases.  Phase  I  b  concerned  with 
analyzing  the  SIE  criterion  problem  and  its 
motivational  components.  The  criterion  analysis  is 
expected  to  continue  throu^out  the  program,  and 
to  serve  as  an  information  source  pankulaily  for 
Phase  II,  the  prediction  study.  The  prediction 
phase,  whidi  include  a  ^daUy  constructed 
version  of  a  BI,  b  the  most  critical  ccmiponent. 
Hopefully,  it  wiO  result  in  an  operational  selection 
technique  for  imp.'oving  selection  decisons  by 
capitalizing  on  an  increased  understanding  of 
mothrational  factors  functioning  in  Air  Force 
training  programs. 

Pending  successful  results  in  Phase  II,  Phase  III 
of  the  program  will  be  concerned  with  the  meas¬ 
urement  of  motivational  chaise  as  a  function  of 
motivational  training.  The  motivational  c’  ange 
aspect  adds  an  important  dimension  'o  the  oveiaD 


study  by  evaluating  attempts  to  modify  motiva¬ 
tion  and  thereby  complementing  tfie  selection- 
oriented  aspects  of  Phase  II. 

The  purpose  of  this  report  is  to  review  relevant 
literature,  to  present  the  overall  research  design  of 
the  project  with  respect  to  the  three  phases,  and  to 
report  <hi  specific  procedures  and  results  (Stained 
in  the  first  year  of  data  collection.  All  of  tlie 
progress  section  deals  v^lth  progress  reached  in 
Phase  I  and  II,  sittce  intensive  work  on  Phase  II! 
has  not  yet  begun. 


II.  RCVIEWOF-niEUTERATtJRE 

Occupational  Motivation 

While  there  has  been  a  good  deal  of  interest  in 
the  impact  of  motivational  variables  upon  occupa¬ 
tional  performance  and  tenure,  operationalizing 
these  motivational  variables  has  accomplished  little 
in  the  way  of  enhandng  prediction.  In  fact,  there 
seem  to  be  some  definitional  problems  in  deter¬ 
mining  wdiat  qualified  as  a  motivational  variable 
across  differing  theoretical  points  of  view.  A  brief 
discussion  of  the  more  prominent  theories  of  work 
motivation  may  allow  for  some  clarification  of  the 
problem  areas  which  exist,  and  may  suggest  some 
relevant  motivational  dimensions  to  be  studied  as 
potential  predictors  of  voluntary  elimination. 

In  their  review  of  motivational  theory  as  it  had 
been  puraied  in  the  study  of  managers,  Cummings 
and  QSalmi  (1968)  conduded  that  Herzberg’s 
motivation-hygiene  conceptualization  and 
Maslow’s  hierarchical  theory  sparked  the  two 
dominant  lines  of  research  that  emerged  during  the 
decade  prior  to  1968.  .Although  Herzbetg’s  theory 
has  generated  research  v/ith  equivocal  condusions, 
the  sheer  volume  of  research  and  comment  it  has 
spawned  testifies  to  the  theory’s  rmpact  on  the 
field.  In  short,  the  twc-factor  structure  inherent  in 
the  motivation-hygiene  theory  states  that  the 
opposite  of  job  satisfaction  is  not  job  dissatisfac¬ 
tion,  but  rather  a  lack  of  job  satisfaction.  From 
the  same  theoretical  bads,  the  oppostc  of  job  dis¬ 
satisfaction  is  not  job  .satisfaction,  but  rather  a 
lack  of  job  dissatisfaction. 

For  Herzberg,  job  satisfaction  and  job  dissatis¬ 
faction  are  both  feelings  which  stem  from  specific 
clc'-  icnts  of  a  job  situation.  Elements  which  contri¬ 
bute  to  job  satbfaction,  however,  are  not  the  same 
as  those  whidi  contribute  to  job  dissatisfaction. 
The  former  elements  are  called  “satisfiers”  or 
"motivators”  and  are  concerned  with  job  content 
considerations  such  as  achievement,  recognition, 
and  intrinsic  interest  in  the  task.  The  elements 
which  contribute  to  job  dissatisfaction  are  called 


“dissatisfiers”  or  ‘‘hypenc,”  and  .indude 
aspects  of  the  job  context,  such  as  supervision, 
physical  environment,  salary,  and  working 
conditions. 

Herzberg’s  theory  is  essentially  one  of  environ¬ 
mental  or  organizational  control  which  in  turn 
leads  to  changes  in  motivation.  As  such,  it  is  not 
directed  to  the  problem  of  predicting  who  will 
exhibit  high  motivation  in  a  given  organization. 
Rather  than  postulating  motivational  dimensions 
upon  which  people  may  be  ordered,  Herzberg 
assumes  two  general  motives  characteristic  of  aD 
men.  Those  general  motives  arc  the  seeking  of 
potential  and  the  avoidance  of  pain  or  displeasure. 
The  degree  to  which  motivation  is  exhibited  in  an 
organization  is,  then,  dependent  upen  organiza¬ 
tional  characteristics  rather  than  individual  differ¬ 
ences  in  motivation.  Upon  viewing  the  problem  of 
deficient  motivation  in  a  training  program  such  as 
Undergraduate  Klot  Trainrng,  Herzberg  would 
suggest  organizational  change  rather  than  increased 
predictive  power  as  *he  best  sdution.  In  fact,  thi* 
is  exactly  what  he  has  suggested  (Herzberg 
W'inslow,  &  Majesty,  1%9). 

While  it  is  recognized  that  selection  and  training 
:n  the  form  of  organizational  design  may  supple¬ 
ment  each  other  nicely,  the  scope  of  this  project  is 
presently  concerned  with  problems  more  directly 
related  to  motivational  differences  between  people 
than  defining  other  more  extra-individual  organiza¬ 
tional  characteristics. 

Maslow’s  work  in  developing  his  hierarchical 
theory  of  motivation  has  led  to  a  number  of 
studies,  including  those  by  Porter  (1%1,  1962. 
19633,  1963b,  1963c,  1964, 1967)  in  which  levels 
of  need  satisfaction  as  influenced  by  various 
organizational  variables  have  been  investigated. 
The  hierarchical  theory  holds  tl.-at  needs  or 
imbalances  are  diarccteristic  of  all  men  and  that 
certain  needs  are  prepotent  over  others:  that  is, 
they  will  be  subject  to  need  reduction  behavior 
prior  to  attempts  to  reduce  other  higher  order 
needs.  Specific  sets  of  needs  in  order  of  their 
prepotency  include  physiological  needs,  safety 
needs,  love  needs,  esteem  needs,  and  sdf- 
actualization  needs.  IndiviJual  differences  in 
motivation  are  reflected  by  varying  levels  of  need 
satisfaction  across  the  classes  of  needs.  Behavioral 
Jiffcrcnccs  would  be  the  result  of  the  lowest  level 
of  need  which  is  unfulfilled.  Because  Maslow’s 
theory  is  based  upon  need  satisfaction  obtained 
from  the  environment,  it  acknowledges  the  impor¬ 
tance  of  situational  determinants  of  behavior.  But 
since  it  is  a  more  general  theory,  it  docs  poten¬ 
tially  allow  for  prediction  from  general  patterns  of 
need  deficiencies. 
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Some  attempts  have  been  m^ne  to  synthesize 
the  motivation-hy^ene  attd  the  hierarchical 
theories  (Sdiman,  1970;  Wdf,  1970).  In  general, 
Herzberg  and  Madcw  are  talkng  about  two  sides 
of  the  same  coin,  wth  Herzberg  s-ressing.the  end 
state  of  motivational  bdiavior  (ie..  satisfaction  or 
dissatisfaction)  and  Madow  strejdng  the  force 
{it!.,  reed)  whidi  directs  one  toward  that  end 
state. 

Since  Maslow  appears  to  soinewhat  more 
interested  in  the  force  which  prompts  behavior 
than  in  the  situational  determiiu  ,  it  would  seem 
that  he  offers  more  toward  spedf/  ir-g  motivational 
differences  between  oeopie  whldi  may  be  exam¬ 
ined  as  predictors  oi  voluntary  elimination. 

ftfcCielland,  Atkinson.  Oark,  and  Lo«'eD 
(1935)  have  emphasized  the  Need  for  Achieve¬ 
ment  as  an  important  motive  in  determining  work 
behavior.  Althou^  McGelland  has  lately  become 
concerned  with  otlier  motives  such  as  Need  for 
Power,  most  of  his  research  has  been  dbected 
toward  developing  understanding  of  those  peo{4e 
who  strive  toward  achievement.  His  theoretical 
position  is  most  closely  associated  with  the  need- 
press  theory  of  Murr^  (1952),  the  major 
difference  bdng  that  McClelland  has  taken  a  more 
microscopic  analysis  of  one  of  tlie  needs  orighully 
propos.'d  by  Munay.  McClelland’s  conceptualiza¬ 
tion  of  Need  for  Achievement  is  that  it  is  a 
dimension  of  motivatio.n  which  can  be  used  in  a 
predictive  model,  but  wiiidi  is  also  subject  to 
change  due  to  training.  Thus,  while  it  interacts 
with  tlic  situation  to  produce  behavior,  it  is  a 
motivation  dimension  upon  whidi  individual 
differences  exist.  The  same  analysis  applied  to 
Need  for  Achievement  would  be  applicable  to 
other  needs  in  the  tradition  of  Murray. 

In  spite  of  the  meaningful  tlteories  cited, 
attempts  made  toward  developing  measures  of 
needs  as  defined  by  either  Murray  or  McQcIiand 
have  as  yet  not  met  with  gicat  success  in  piedic- 
ting  actual  performance  or  tenure  criteria. 
Measurements  made  through  projective  techniques 
{e.g..  Thematic  Apperception  Test)  have  proven  to 
lade  inter-scorer  reliability  (Lindzey  Heineman, 
19S5).  Equally  important  in  a  situation  where 
large  numbers  of  applicants  xe  being  tested  is  the 
prohibitive  amount  of  professional  iLne  required 
to  administer  and  score  most  projective  tests. 

Objective  measures  of  Need  for  Achievement 
also  appear  to  have  fallen  short  of  achkmg  utility 
in  predicting  performance  or  tenure  criteria 
(Edwards,  1954;  Gou^,  1965;  Hermans,  1970; 
Mukheijec,  1964;  Stem,  1970).  Of  the  objective 
measures  used,  the  California  Psychdogicai 
Inventory’s  (CPI)  two  achievement  scairs.  Achieve¬ 


ment  via  (TOnformance  and  Achievement  via 
Independence,  bav*  ittained  moderate  validity  in 
predicting  achievement  in  )Kademi',  settings. 

Perhaps  one  of  ihe  major  limiting  factms  of 
objective  measures  of  Need  for  Achievement  has 
been  the  multidimensionality  of  criteria  as  well  as 
of  the  predictors.  Indtision  of  items  in  te^  scores 
which  correlate  with  the  total  score  but  not  with 
the  criterion  only  serves  to  increase  the  nonvalid 
variance  of  the  predictor.  Some  efforts  are  bdng 
made  to  apfdy  reductirmistk  techniques  to 
personality  constructs  in  hope  that  both  predictive 
validity  and  construct  validity  may  be  increased 
(Fiske  &.  Pearson,  1970).  Attenqrts  to  sort  out 
dimensions  of  various  personality  constructs  have 
resulted  in  mudi  debate  over  the  impact  of  sudi 
aspects  as  social  desirability,  endorsement  fre¬ 
quency,  and  k^ing  direction  of  items  (Edwards, 
1957;  Jackson  Sc.  Messkk.  1961;  1%5;  Rorer  Sc 
Goldbeig,  1%S).  As  a  solutiim  to  the  confounded 
components  of  test  score  me^iit^  Block  (1%S) 
suggests  that  criterion-oriented  personality  tests 
lead  to  the  most  meaningful  interpretations  once 
they  are  based  upon  empirical  vahdity. 

'  Other  less  fuOy  developed  strat^ies  of  defining 
and  measuring  occupational  motivation  have  used 
mote  of  an  empirical  validation  approach.  Drawing 
from  Atkinson's  (1964)  work,  Hackman  and 
Porter  (1968)  have  d^oped  an  expectancy 
modei  whkh  diey  have  used  primarily  to  predict 
job  performance.  However,  the  theoretical  rela- 
tkm^p  between  expectancy  and  incentive  would 
seem  to  apply  as  welJ  to  turnover  as  to  perfoim- 
anice. 

Hang  a  sample  of  scientists,  Goodman,  Rose, 
and  Lurcon  (1970)  have  compared  the  validity  of 
the  expectancy  m^el  of  Hacknup  and  PcHler  to 
tiiree  other  models  of  nictivation  which  were 
selected  from  the  work  of  Pelz  and  Andrews 
(1966).  The  tliree  models  of  Pdz  and  Andrews 
included  direction  orientation  {ie.,  advancement 
of  scieiKe  or  advancement  of  self-status  in  the 
<»ganizatiun),  source  of  motivational  stimulaticn 
(whether  internal  or  external),  and  job  dedication 
(i.e..  intensity  of  work  motivation).  The 
expectam^'  model  provided  the  best  predictor  of 
work  perfomunce  among  scientists  and  engineers. 
One  of  the  suggested  reasons  for  the  superiority  of 
the  expectancy  model  was  the  more  criterion- 
specific  nature  of  the  predictor  variables  uxd 

As  a  concluding  comment  on  theories  of 
motivation,  it  appeals  that  while  there  hss  been  a 
great  volume  of  research  on  altitudinal  and 
motivational  variables  as  they  appear  in  the 
industrial  environment,  it  may  be  chat  such 
research  has  generated  more  heat  than  light. 
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Himiciu  (1970)  points  out  that  one  aspect  vibjdi 
has  been  consistently  missing  from  current 
research  on  motivational  attitudinal  vanabks  is  a 
so{dusticated  examination  of  their  relationships  to 
orgnizational  outputs  such  as  productivity,  turn¬ 
over,  and  absenteeism.  One  feature  which  the  avid 
propmeiits  of  empirical  scale  construction  have 
consistently  stressed  is  that  the  fulure  to  base 
motivation^  ccmstiucts  upon  those  ispects  of  the 
indindual  vdiidi  actually  relate  to  observable 
behavior  has  resulted  in  theories  of  occupational 
motivation  with  very  weak  ties  to  behavior. 

The  following  section  deals  with  scune  general 
and  specific  correlates  of  turnover  and  provides  a 
second  ba^  of  suggesting  technique  and  content 
which  am  unravel  srme  of  the  complexities 
inherent  fri  motivatkm. 

Turnover  and  Modvatiotta]  Qiteria 

The  understairdingand  prediction  of  turnover  is 
replete  with  specific  pr^lems  whidi  are  not 
generally  characteristic  of  the  understanding  and 
prediction  of  job  performance.  An  employee 
either  leaves  his  job  one  way  or  another,  or  he 
tenuins  on  the  job.  Once  he  leaves,  he  usually  is 
not  pven  the  opportunity  to  leave  again,  simply 
because  he  is  not  rehired.  On  the  other  hand,  job 
performance  can  typically  be  conceived  to  consist 
of  certain  dimenaons  of  goodness  or  excellence 
along  which  employees  can  be  ordered. 

Although  it  may  be  argued  that  there  is  really  a 
,  continuum  wfaidi  underlies  the  turnover  variabV, 
thus  rendering  it  a  false  dichotomy,  the  fact 
remains  that  it  is  usually  manifested  as  a  dichotp 
mous  variable.  Otdy  under  very  unusual  circun. 
stances  may  an  employee  partially  leave  a  position 
and  thus  break  up  the  sh^  dichotcunous  nature 
of  turnover.  Such  a  possibdity,  however,  appears 
to  be  limited  largely  to  cases  such  as  those 
involving  proi'essional  persoruiel  who  work  across  a 
number  of  organizations. 

The  discussion  of  turnover  presented  in  thb 
repmt  is  intended  to  evaluate  the  success  in 
predicting  turnover  achieved  with  various  types  of 
predictors  and  techniques.  In  addition,  studies 
which  involved  similar  motivationally  relevant 
criteria  and,  which  were  conducted  in  a  military 
environment  are  induded. 

Schuh  (l%7)  has  reviewed  the  literature  con¬ 
cerning  the  prediction  of  turnover  across  a  variety 
of  organizations,  and  has  commented  on  the 
success  of  various  dasscs  of  predictors  including 
inteUigcnce  tests,  aptitude  tests,  interest  tests, 
personality  tests,  job  satisfaction  questionnaires, 
and  biograi^ical  information. 


InteDigence  tests  and  {.  ^rsonality  tests  demon¬ 
strated  no  systematic  relationship  to  turnover  as 
results  have  been  postive,  native,  unrelated,  and 
even  curvilinear.  Aptitude  tests  revealed  relation¬ 
ships  very  similar  to  those  for  intelligence  tests  and 
personality  tests  with  one  interesting  finding 
demonstrating  that  aptitude  tests  could  predict 
turnover  among  those  discharged,  but  net  among 
those  who  left  voluntarily  (MacKinney  &.  Wolins, 
1959).  Evidently,  factors  other  than  ability  are 
bdiind  vcriuntaiy  attrition. 

Some  more  positive  results  in  prediction  turn¬ 
over  have  been  obtained  with  interest  inventories 
(Datm  &  Abrahams,  1970;  Wiskoff,  1969),  job 
satisfaction  questioniuiies  (Heizbeig,  Mausner, 
Peterson,  &  CapwcU,  1957;  Kerr,  1948;  Vtoon, 
1964),  and  biograpliical  infexmation  (Dann  & 
Abrahams,  1970;  Wiskoff,  1969).  Non-Intellecttve 
dimensions  measured  by  such  devices  seem  to  bear 
stronger  empirica]  and  theoretical  relationships  to 
longevity  in  a  particular  job  or  position. 

Those  who  have  conducted  predictive  studies 
dealing  with  motivationaQy  relevant  criteria  in 
pflot  training  and  other  mOitary  traim'ng  programs 
have  investigated  a  variety  of  predictors.  For 
example,  biographical  self-report  items  have 
demonstrated  the  ability  to  diffeientia;*  between 
“pilot  aspirants”  and  “non-aqnrants”  (Ciarlo, 
1964),  while  projective  xoring  techniques, 
utflizing  motivational  constructs,  have  been  unable 
to  provide  much  utility  in  predictiiig  completion 
and  elimination  criteria  at  the  Air  Feme  Academy 
(Mills,  1969).  It  is  particularly  disconcerting  to 
note  that  in  the  latter  study,  riimination  for  lack 
of  derite,  the  criterion  most  related  to  SI  E  on  a 
conceptual  basis,  vyas  the  least  predictable  elimina¬ 
tion  criterion. 

In  an  Air  Force  study  of  Ute  measurement  and 
prediction  of  scientifiocpcifonnancc,  BI  keys 
(both  empirica]  and  a  priori)  were  the  most  valid 
psycholo^cal  tests  of  the  130  predictors  used  to 
predict  over  50  criteria  (Taylor,  Smith,  Ghiselin,  & 
Ellison,  1961).  Among  the  other  motivational 
predictors  tried  were  Mitumum  Satisfactoiy 
Ability  Level  rating  scales  dr<elopcd  on  the 
project  to  show  the  person's  minimum  a^iration 
levd.  These  sdf-dcscriptior  scores  were  also 
compared  with  .self-ratings  on  the  corresponding 
present  abOitics  to  yield  difference  semes  riiowing 
the  degree  of  aspiration  o.''  each  person.  On  the 
average  these  motivatioiul  scores  were  valid  for  25 
percent  of  the  50  on-the-job  critc.Ta,  quite  an 
effective  “batting  average”  for  such  sliort  and 
economical  devices.  Of  ^cial  note  was  the 
finding  that  a  supervisory  rating  of  motivation  was 
validly  predicted  by  three  a  priori  keys  from  the 
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BI  and  six  self-ratings.  A  motivational  B1  key  was 
also  develq>ed  to  predict  the  motivation  criterion. 
Although  this  initial  empirical  motivational  key 
did  predict  successfully  at  a  very  hi^  level  on  the 
initial  keying  sample,  no  opportunity  was  available 
to  obtain  cross  validities. 

A  further  series  of  related  studies  has  been 
carried  out  over  a  number  of  years  with  support 
from  the  United  States  Navy.  In  these  studies  bio¬ 
graphical  data  were  used  to  predict  a  variety  of 
criteria  including  Officer  Candidate  Performance 
(LaGaipa,  1960),  Success  in  .Qectronic  Schools 
(Thomas,  Thomas,  &  Swanson,  I96S),  Naval 
Reserve  Officer  Training  Corps  Selccucn 
(Neuman.  Githens,  &  Abrahams,  1967),  Retention 
of  Enlisted  Personnel  (Dann  &  Abrahams,  1969): 
Widcoff,  1969),  C^eer  Motivation  (Lau,  Lacey,& 
Abrahams,  1969),  and  Naval  Academy  DbenroQ- 
ment(Dann&  Abrahams,  1970). 

These  studies  have  typically  involved  a  limited 
number  of  biographical  items  (c.g.,  50  to  7S)  and, 
in  additicn,  have  not  induikd  many  types  of  items 
which  are  often  included  in  some  biographical 
studies  such  as  interest  patterns,  aspirations,  and 
values.  The  studies  have  met  with  vatying  degrees 
of  success  which  may  in  ^art  be  due  to  the  limited 
sc(^  of  the  biographical  data  studied.  One  of  the 
most  relevant  and  promising  studies  (Dann  & 
Abrahams.  1970)  concerned  Naval  Academy  Dis- 
enroDment  and  used  35  biographical  items,  laigely 
open-ended,  and  the  Strong  Vocational  Interest 
Blank  (SVTB).  Cross  validities  in  the  twenties  and 
thirties,  respectively,  for  the  two  instruments  were 
obtained  in  predicting  the  disenrollment  criterion. 
Wiskoff  (1969)  also  investigated  background 
information  and  the  SVIB  as  predictors  of  officer 
retention.  In  both  cases  special  empirical  keys 
were  developed  and  cross-validated,  resulting  in 
significant  but  not  striking  correlations.  Again,  a 
vciy  limited  number  of  biographical  items  were 
used. 

It  is  not  surprising  that  empirical  test  construc¬ 
tion  from  biographical  items  has  demonstrated 
validity  in  predicting  motivationally  relevant 
criteria  in  miUtaiy  training  because  biographical 
information  has  proven  itself  to  be  a  most  success¬ 
ful  tool  for  predicting  various  criteria  of  both 
academic  and  occupational  performance  (Taylor  & 
Qlison,  1967).  Biographical  approaches,  when 
tlicy  arc  not  unnecessarily  restricted  in  item 
content,  allow  for  a  unique  combination  of  sound 
technique  built  on  the  importance  of  predicting 
actual  behavior,  coverage  of  multiple  content 
areas,  and  the  empirical  determination  of  motiva¬ 
tional  aspects  underlying  voluntary  elimination. 


III.  RESEARCH  DESIGN 

This  section  presents  an  overview  of  the 
researdi  strategy  for  the  entire  study  as  it  was 
envisioned  early  in  the  research  project.  Hence, 
some  of  the  research  efforts  discussed  here  have 
been  completed,  some  are  currently  in  process, 
and  others  arc  yet  to  be  carried  out.  I.ater  sections 
des>:iibe  the  actual  researdi  and  development 
ccMiipleted  in  the  first '  ear  of  data  ccrflection. 

Phase  l-Anaiyns  of  the  Criterion 
Problem 

Since  the  major  criteria  in  the  present  study  are 
those  based  on  the  SIE  group  from  UPT  (UPT- 
SiE),  the  criterion  analysis  f^ocused  on  critical 
2spccts  of  the  SIE  group.  Particular  attention  was 
to  be  ^ven  to  the  motivational  components  of 
those  in  the  SIE  gioup.  While  the  usual  rationale 
for  studying  the  criterion  problem  is  to  further  the 
efforts  for  tlie  development  of  new  enu'^on 
measures,  the  analysis  of  die  SIE  attrition  group 
was  not  meant  to  supplant  it  as  much  as  to 
increase  understanding  of  its  dimensionality  and 
thereby  allow  for  belter  prediction.  Goals  of  the 
analysis  of  the  SIE  attrition  group  were  to  deter¬ 
mine  its  rchtionship  to  other  criterion  groups, 
consistency  across  training  sites,  predictability, 
relevancy,  and  degree  of  contamination  and  bias. 

The  analysis  of  the  criterion  has  been  referred 
to  as  Phase  1  of  this  research  project,  and  was  so 
derignated  because  it  was  initiated  first  rather  than 
because  it  totally  and  discretely  preceded  Phases  II 
and  III.  Phase  I  actually  continues  to  be  an 
important  effort  throughout  the  duration  of  the 
prrycct,  as  is  indicated  by  the  block-flow  diagram 
depicted  in  Figure  1 . 

A  preliminary  criterion  analysis  of  224  SIEs 
from  f  JPT  was  completed  using  data  available  early 
in  the  project  from  the  1969  Faculty  Board 
Proceedings.  The  analysis  was  concerned  with 
classifying  into  subcategories  those  tr.iinccs  who 
belonged  to  the  SIE  attrition  groous,  and  was 
limited  to  the  information  readily  obtainable  from 
those  records.  The  lc:<ts  of  the  records  were 
reviewed  by  a  research  staff  p^chologist,  who 
then  classified  the  major  reasons  for  dropping  out 
of  training  as  expressed  by  each  trainee.  This 
analy^  was  quite  helpful  in  construction  and 
selection  of  predictors.  Although  •nfeicnccs 
concerning  the  nature  of  future  SIEs  wire  uiade, 
no  confident  inferences  concerning  differences 
between  SIEs  and  non-SIEs  were  possible  since  no 
data  were  yet  available  on  successful  graduates  of 
UPT. 
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Continued  analysis  will  be  conducted  with  the 
trainees  who  made  up  this  study’s  sample.  Whereas 
the  earlier  parts  of  the  analysis  were  designed  to 
9ve  clues  as  to  what  Itinds  of  items  were  needed  to 
predict  who  would  voluntarily  drop  out  of  train¬ 
ing,  the  latter  stages  would  be  concerned  with 
examining  the  psychometric  limitations  on  the 
obtainable  validities. 

Since  there  are  SIE  groups  in  other  Air  Force 
training  programs,  the  opportuniQr  would  present 
itself,  in  the  validity  generalizatioi  stage  of  the 
prediction  phase,  to  determine  if  there  were 
common  characteristics  among  SlEs  regardless  of 
training  group.  Similar  sets  of  validities  would 
suggest  that  there  were  common  characteiistics, 
whereas  differing  patterns  of  validities  would 
suggest  uniqueness  «4iid:  Is  situationally  deter¬ 
mined  by  the  nature  and  setting  of  the  training 
program. 

Phase  ll-Oevetopment  of  the 
Predictor  Battery 

The  predictor  phase  of  the  project  is  presented 
graphically  in  the  upper  .,ection  cf  Figure  I.  As 
can  be  noted.  Phase  11  began  with  the  building  of 
an  item  pool.  The  item  pool  was  developed  from 
the  criterion  analysis  and  fiom  information  gained 
throu^  prior  biographical  research,  as  reviewed 
previously.  The  item  pool  contained  approxi¬ 
mately  2,500  items  when  the  selection  of  items  for 
the  first  predictor  battery  was  made. 

The  899  items  chosen  for  the  first  battery. 
Predictor  Battery  A,  were  selected  from  the  item 
pool  through  a  number  of  bases.  Two  Bis  with  300 
and  299  items  respectively  were  developed  to 
ensure  a  wide  range  of  content  frcun  those  items 
which  had  qualified  for  the  initial  item  pool.  In 
addition,  the  Activities  Index,  a  300-item  person¬ 
ality  test,  was  diosen  as  a  result  of  early  data 
an^yas  reported  <mi  an  ongoing  project  at  the  Air 
Force  Academy. 

Data  analysis  of  the  first  predictor  battery  was 
designed  to  yield  two  types  of  information  that 
relate  both  to  validation  and  to  item  retention. 
The  design  would  involve  validation  utilizing  both 
internal  and  external  criteria  and  both  a  priori  and 
empirically  developed  keys.  The  approach  was  to 
be  criterion-oriented  in  that  the  primary  objective 
was  concerned  with  discovering  which  individual 
items  and  groups  of  items  were  predictive  of  the 
criteria.  However,  a  priori  scores  such  as  those 
measuring  constructs  can  be  used  in  a  criterion- 
oriented  approach  through  multiple  regression,  a 
procedure  v^kh  enhances  prediction  when  there 
are  a  number  of  scores  all  related  to  a  criterion  but 


only  dightly  related,  unrelated,  or  negatively 
•elated  to  each  otlier. 

Since  the  data  analytis  was  to  be  a  continuous 
process  as  data  became  available,  this  would 
permit  a  selection  of  items  for  the  second  battery 
that  were  the  most  valid  predictors.  The  second 
predictor  battery.  Predictor  Battery  B,  was  to  be 
constructed  by  dropping  the  invalid  items  from 
the  first  battery,  retaining  the  valid  items,  writing 
new  items,  and  selecting  item:  from  the  pool 
wdiich  ^ould  best  serve  to  increase  the  validities 
obtained  with  the  first  battery.  This  process  is 
depicted  in  Figure  1  by  the  arrows  running  from 
the  first  predictor  battery  to  the  valid  items  and 
then  to  the  second  predictor  battery.  The  arrows 
attaching  the  valid  items  to  the  item  pool 
represent  an  examination  and  comparison  of  valid 
items  with  items  from  the  pool  to  best  select  new 
items  for  Predictor  Battery  B.  The  invalid  items 
were  sifted  out  of  the  first  predictor  battery  and 
omitted  from  future  consideration,  as  shown  by 
the  arrow  stemming  fiom  validation  to  invalid 
items. 

The  analysis  of  Predictor  Battery  B  would 
involve  the  same  general  techniques  as  employed 
with  the  first  b?.'>tery,  as  can  be  seen  from  the 
simUar  stnrcture  of  the  block-flow  diagra.m  about 
the  validation  of  the  second  predictor  battery. 
Then  cross  validation  keys  would  be  produced  to 
predict  eadt  of  the  criteria  used  in  the  study,  and 
the  battery  would  be  shortened  to  include  only 
valid  items.  Assuming  successful  findings,  the 
resulting  set  of  items  would  cmnprise  a  predictor 
which  could  be  the  basis  for  validity 
generalization. 

This  third  battery.  Predictor  Battery  C,  to 
include  the  most  valid  items  in  Batteries  A  and  B, 
would  be  suitable  for  comparing  validities  for 
Officer  Training  School,  Air  Force  Academy, 
Undergraduate  Pilot  Training.  Undergraduate 
Navigator  Training,  and  Undergraduate  Helicopter 
Training.  Validities  would  be  generated  using  the 
empirical  keys  developed  in  the  first  and  second 
predictor  batteries.  Where  possible,  new  keys 
would  also  be  developed  in  order  to  ascertain  the 
usefulness  of  these  specially  developed  keys  as 
opposed  to  the  keys  developed  in  Ae  first  two 
batteries. 

Phase  lll-IMeasurefnent  of 
Motivational  Change 

The  selection  a^ct  of  the  study  operated  on 
the  assumption  that  liicre  were  measureable  indi¬ 
vidual  diffe'enecs.  which  existed  at  the  time  the 
selection  battery  was  completed,  which  were 
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stable  enough  to  predict  success  or  failure  in  the 
training  programs  under  consideration,  and  which 
could  be  used  in  future  selection  situations.  A 
further  point  of  concern  deals  with  the  possibility 
that  some  change  in  those  individual  differences 
used  for  selection  may  occur  as  the  result  of  time 
or  experience  in  the  training  program  under 
consideration.  As  an  approach  to  the  problem  of 
change,  there  would  be  readministration:  of 
selected  items  from  the  test  battery  at  the  conclu¬ 
sion  of  the  training  progran's.  The  intent  of  the 
rcadministrations  was  to  ascertain  which  items 
were  subject  to  signiHcant  change  in  response  as  a 
result  of  exposure  to  Air  Force  training.  There 
were  at  least  two  possibilities  for  shifts  in  attitude. 
One  would  be  reflected  by  trainees  who  success¬ 
fully  completed  training,  and  the  other  would  be 
rcllcctcd  by  those  who  failed  to  complete  the 
program  for  one  reason  or  anotlicr.  Tfie  various 
possibilities  will  be  examined,  and  training  recom¬ 
mendations  based  upon  relevant  conclustuns  will 
be  discussed. 

Interrelationships  Among 
Phases 

It  should  t'C  apparent  that  the  three  phases  of 
the  project  are  c^'n’-plcmentary  and  interdepend¬ 
ent.  The  predictor  phase  is  to  some  extent 
dependent  upon  the  analysis  of  the  criteria  and  the 
criterion  urndysis  would  be  augmented  by  informa¬ 
tion  gained  as  a  result  of  the  predictor  phase.  The 
measurement  of  motivational  change  is  closely 
related  to  the  understanding  of  the  criterion 
problem  and  its  motivational  components.  The 
operational  aspect  of  the  measurement  of  motiva¬ 
tional  change  is  the  testing  component  of  the 
predictor  phase. 


tv.  PKOCI-DtIRK 

Whereas  the  previous  research  design  section 
revealed  the  overall  project  design,  the  present 
progress  section  is  intended  to  deal  with  specific 
methods  and  procedures  used,  results  obtained, 
and  conclusions  and  recommendations  reached 
after  the  first  year  of  data  collection.  As  such  it 
deals  exclusively  with  accomplishments  in  the 
criterion  analysis  phase  (PIrase  1)  and  the 
prediction  phase  (Phase  11)  of  the  study. 


'Melvin  S.  Majesty,  1969:  personal  conimnnication. 

^Collection  of  the  UTS  data  was  supervised  by  LtCol 
Melvin  S.  Majesty  with  the  aid  of  Sgt  Paul  Mooiny  of 
AFHlll./ED  and  Dr.  lllair  McDonald  of  the  University  of 
Utah. 


Predictors 

The  research  design  section  presenteo  the 
general  strategy  in  the  development  of  predictor 
measures  in  the  treatment  of  the  criierion  analysis 
and  predictor  phases  of  the  project.  The  first  step 
in  the  development  of  the  predictor  measures  was 
to  gain  as  much  information  as  possible  concerning 
the  nature  of  the  primary  attrition  group, 
UPT-SIE.  Information  concerning  the  nature  of 
the  UPT  program  and  perceptions  of  charac¬ 
teristics  of  SIEs  v.’cre  gathered  from  various  Air 
Force  personnel  who  had  contact  with  the  UPT 
program  and  from  official  Air  Force  records.  The 
impact  of  these  analyses  was  directly  channeled  to 
the  development  of  the  predictors. 

An  item  pool  was  accumulated  by  writing  new 
biographical  items  suggested  by  the  criterion 
analysis,  by  selecting  items  used  in  previous  bio¬ 
graphical  research  which  had  demonstrated 
validity  against  criteria  conceptually  similar  to  SIE 
attrition  criteria,  and  by  selecting  existing  tests 
which  purportedly  measured  personality  or 
motivational  attributes  appearing  to  underlie  the 
SIE  phenomenon.  The  item  pool  contained 
approximately  2,S(X)  items  when  the  first  pre¬ 
dictor  battery.  Predictor  Battery  A,  was  formed. 
The  selection  of  items  included  in  Predictor 
Battery  A  was  based  to  a  great  degree  upon 
synthetic  validity  approaches  and  upon  informal 
hypotheses  resulting  from  the  analysis  of  the 
criterion. 

The  89<J  items  chosen  for  Predictor  Battery  A 
were  selected  to  ensure  a  wide  range  of  content 
from  those  items  which  had  qualincd  for  the 
initial  item  pool.  The  final  899  items  chosen  were 
divided  among  three  test  forms,  Biographical 
Inveniory  Forms  I  and  II  and  the  Activities  Index, 
a  300-itcm  personality  test  which  yielded  30  Need 
Scores  and  1 2  Factor  Scores  of  reported  motiva¬ 
tional  signillcance  in  a  study  at  the  Air  Force 
Academy.'  B1  Form  1  also  yielded  four  a  priori 
scores  for  Motivation,  Academic  Pcrfomiance, 
Creativity,  aiid  Leadership.  BI  Form  if  was 
sufficiently  new  that  no  a  priori  scores  were 
available. 

Data  Collection  an  d  Sample 

Battery  A  was  administered  to  all  active 
students  in  the  OTS  program  operating  at  Lack- 
land  Air  Force  Base,  San  Antonio,  Tex.'is.  Testing 
began  January  1970  and  was  terminated 
November  1970.’ 
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Each  entering  class  of  OTS  students  was  tested 
within  two  weeks  after  their  entry  into  OTS.  Two 
exceptions  to  this  procedure  occurred  during  the 
early  stages  of  the  project  when  two  testing 
sessions,  one  in  January  1970  and  one  in  April 
1970,  were  used  to  gather  predictor  data  from 
eight  OTS  classes.  Four  OTS  classes  were  rested 
during  each  of  the  two  testing  sessions.  After  a 
commitment  was  made  to  the  commander  of  OTS 
to  examine  attrition  in  OTS  itself,  it  was  decided 
to  test  all  trainees  early  in  OTS  to  avoid  differ¬ 
ential  selectivity  operating  across  classes.  Testing 
of  mere  than  one  class  at  a  time  resulted  in  some 
classes  being  assessed  early  in  OTS  and  others  late 
in  OTS.  Hence,  OTS  attrition  percentages  for 
those  classes  on  whom  predictor  data  became 
available  would  have  differed  depending  upon  the 
point  in  the  OTS  training  program  at  which  they 
had  been  tested. 

The  total  sample  used  in  the  data  analysis 
consisted  of  645  Air  Force  trainees  who  were 
scheduled  to  enter  UPT  upon  successful 
completion  of  their  12-week  OTS  program. 
Although  every  attempt  was  made  to  test  aU 
subjects  in  the  Lackland  Air  Force  Base  OTS 
program,  beriming  with  OTS  class  70-08,  some 
students  eluded  the  sample  by  dropping  out  of 
training  prior  to  administration  of  the  predictors. 
Due  to  the  one-shot  nature  of  turnover  criteria, 
these  unpretested  OTS  dropouts,  however,  did  not 
explicitly  bias  the  sample  on  any  of  the  OPT 
attrition  criteria:  Le.,  they  never  get  to  UPT  .md 
could  not  have  dropped  out  of  it. 

AI*'ition  data  consisted  of  tlic  various  possible 
types  of  dropouts  from  either  OTS  or  UPT.  Thest^ 
classes  of  attrition  groups  formed  the  basis  for  the 
attrition  criteria  to  be  discussed  in  a  following 
section.  Tlie  actual  collection  of  the  attrition  data 
was  carried  out  with  tlie  cooperation  of  those 
personnel  administering  the  OTS  and  UPT 
programs.  Periodic  lists  of  eliminees  were  sent  to 
the  research  facility  at  the  University  of  Utah  for 
processing. 

Criteria 

Table  1  presents  the  strategy  involved  in 
developing  external  criteria  from  selected  combi¬ 
nations  of  the  nine  attrition  groups  and  the  success 
group  in  OTS  and  UPT.  Each  column  in  Table  I 
presents  one  of  the  seven  external  criteria  included 
in  the  first  cross  validation  run  of  Predictor 
Battery  A.  It  is  important  to  distinguish  between  a 
criterion  group  {c.g.,  UPT-SIE)  and  a  criterion.  A 
criterion  always  implies  some  scoring  continuum 
and  thus  must  include  two  or  more  criterion 


groups.  These  criteria  were  selected  either  on  the 
basis  of  their  hypothesized  relevance  to  the 
objectives  of  tiie  project,  or  in  terms  of  the 
number  of  subjects  available  in  each  of  their 
attrition  categories.  Obviously,  a  large  number  of 
subjects  was  desirable  in  order  to  stabdize  the 
development  of  the  scoring  keys  and  to  increase 
the  probability  of  obtaining  significant  repeatable 
results. 

Each  criterion  represented  a  different  scaling 
technique  or  a  different  attrition  categoiy  being 
compared  to  the  success  group.  The  intent  in 
working  with  a  number  of  combinations  of  groups 
was  to  tiy  to  detennine  which  measures  and  which 
scaling  techniques  would  be  most  predictable. 
Thus,  for  Table  1,  Criterion  1,  those  who  elected 
to  eliminate  themselves  during  UPf  (UPf  SlE) 
were  coded  as  1,  those  continuing  successfully 
were  coded  as  0,  and  all  other  attrition  categories 
were  coded  as  missing  data  and  thus  did  not  enter 
into  the  analysis  of  that  criterion.  Criterion  2  was 
made  up  of  LTT  Flying  Deficiency  (UPT-FD) 
coded  as  1.  successes  as  0,  and  all  others  as  blank. 
Criterion  3  was  a  composite  of  SlEs  made  up  of 
eitlier  OTS-SIE  or  U^-SIE  categories  both  of 
which  were  coded  as  1 ,  with  successes  as  0,  and  all 
others  blank. 

Criterion  4  included  all  criterion  categories 
except  tile  two  Medical  Elimination  groups 
(OTS-MED  and  UPT-MED)  which  were  thought  to 
be  impervious  to  prediction.  Criterion  5,  Total 
Attrition,  was  concerned  with  all  those  who 
atirited  cither  from  OTS  or  from  UPT,  regardless 
of  the  reason  for  their  elimination.  All  successes 
were  coded  as  0.  There  were  no  cases  coded  as 
missing  data  for  this  criterion  measure. 

Criterion  6  involved  a  hypothetical  scaling 
technique  and  assumed  that  those  who  elected  to 
eliminate  themselves  from  OTS  could  be  character¬ 
ized  as  being  higher  on  a  tumovci  criterion  since 
they  eliminated  themselves  earlier  from  the 
training  programs  than  those  in  UPT  Uang  this 
rationale,  the  OTS-SIE  subjects  could  be  scored  as 
less  satisfactory  flying  officers  or  less  motivated 
than  those  who  elected  to  withdraw  during  UPT 
and  who  would  be  somewhat  closer  to  the 
successful  completion  of  the  program.  To  reflect 
this  scaling,  the  OTS-SIE  group  were  coded  as  0; 
all  other  attrition  categories  were  coded  as  blank 
or  missing  data  and  were  not  considered  for  this 
criterion. 

Criterion  7  represented  an  alternative  rationale 
for  combining  OTS-SIE  and  UPT-SIE.  Since  the 
cost  to  the  Air  Force  was  greatest  for  SfEs  from 
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Table  1.  Scoring  of  Criteria  Developed  from  OTS  and  UPT  Attrition  Groups  and  Success  Groups 


Criterion  Measure* 

Nln 

Attrition  tnU  Succet>  Groups 

1 

2 

3 

4 

5 

c 

7 

Group 

Undergraudate  Pilot  Training 

1 .  Self-Initiated  Elimination  (UPT-SIE) 

I 

1 

I 

1 

1 

2 

92 

2.  Medical  Fiiminatioti  (UPT-MED) 

1 

28 

3.  Rying  Deficiency  (UPT-FD) 

1 

1 

I 

m 

4.  Militaiy  Training  Deficiency  (UPT-MTD) 

1 

0 

5.  .Manifestations  of  i\nxiety  (UIT-MOA) 

1 

1 

19 

6.0Uier(UPT-Other) 

i 

0 

Officer  Trsining  SriiocI 

7.  Self-Initiated  Elimination  (OTS-SIE) 

1 

1 

i 

2 

1 

.35 

8.  Medical  Qimination  (OTS-MED) 

1 

29 

9  Military  Training  Deficiency  (OTSMTD) 

1 

1 

13 

Success  Group 

0 

0 

0 

0 

0 

0 

0 

320 

Total  N 

644 

^Each  ciiterion  mcasuK  must  encompass  at  least  two  contrasting  groups.  Hence,  while  it  makes  sense  .o  speak  of 
die  UPT-SIE  criterion  group,  one  cannot  sper>l:  of  the  UPT-SIE  criterion  unl.'ss  the  groups  which  arc  ccnt.'astcd  widi  the 
UPT-Sir.  criterion  groups  arc  specified. 


DPT,  these  individuals  were  coded  as  highest,  a 
value  of  2,  on  an  economic  value  criterion.  ThL« 
rationale  was  followed  with  the  hope  that  scaling 
these  candidate;  as  higliesl  would  perhaps  increase 
the  possibility  ut  idenUfying  them  witfi  the  Bf 
data.  Th:  OTS-SICs  were  coded  as  ! ,  and  successes 
were  coded  as  0  for  this  measure. 

.\cross  all  the  externa:  criteria  the  successful 
tianiees.  who  were  coded  ss  0,  v  ere  ‘‘lom  OTS 
classes  70^8  or  7(M)9  and  were  stiu  active  trainees 
in  HPT  at  the  time  data  analysis  began.  Trainees 
from  sdbscqvcnt  OTS  cia.sses,  70-10  and  beyond, 
were  not  included  in  the  sample  unless  they  had 
already  dropped  cut  of  OTS  or  UPT.  The  rationale 
for  excluding  active  trainees  from  the  si.cccss 
criterion  group  who  came  from  OT.S  classes 
subsequeii!  to  <.Ia,«s  70-09  was  that  these  trainees 
had  not  been  in  UPT  long  enough  to  yield  a 
success  group  relatively  nncor.taininatcd  by 
potential  chminccs.  a  prospect  which  would  have 
imposed  severe  restrictions  on  the  ability  to 
discriminate  between  successes  and  failures.  On 
the  other  hand,  climmccj  from  OTS  classes 
subsequent  to  class  70-09  v/crc  included  to 
increase  both  the  base  rates  and  the  absolute 
number  of  climinccs  to  a  level  wliich  would 
enhance  and  stabilize  the  validation  results  and  to 
offset  tiic  somewhat  spuriously  low  base  latcs 
among  OT.S  classes  70-08  and  70-09.  7ne  low 
criterion  base  rates  for  OTS  classes  70-08  and 
70-09  stemmed  from  late  testing  of  those  classes 
and  the  resulting  selection  composition  of  ihosc 
groups. 


For  purposes  of  the  study,  the  lenn  iiitcrnal 
criteria  refers  to  measures  which  resulted  from 
item  responses  gatiiered  concurrently  with  the 
predictors.  Included  among  the  internal  criteria 
was  a  Self-Rated  Lack  of  Dedication  to  Com¬ 
pleting  UPT,  and  three  factor  scores  fiom  the 
Activities  Index-  Motivation.  Submissivcncss,  and 
Expressiveness.  The  purpose  of  using  internal 
criteria  such  as  these  was  to  generate  biographies! 
keys  to  add  to  the  meaning  of  the  keys  built 
against  the  external  criteria,  and  to  generate 
additional  keys  to  be  related  to  external  criteria. 

Validatior.  of  A  Priori  Scores 

The  data  ansuysb  reported  here  included  the 
Vdlidatinn  of  a  priori  scores,  the  construction  and 
cross  validation  of  new  keys,  and  the  analysis  of 
tlic  SIE  arirition  group  into  subcatcgnrics. 

A  number  of  61  scoring  keys  developed  in  prior 
studies  as  dc.scrib.-d  in  the  litcratrrc  review  were 
available  and  earned  over  into  the  present  study. 
These  keys  v.'crc  retained  in  order  to  examine  their 
potential  validity  and  to  help  define  other  vari¬ 
ables  included  in  the  study.  The  four  a  priori  81 
keys  included  a  Motivation  key,  a  Creativity  key. 
an  Academic  Performance  key.  and  a  Leadership 
key.  In  addition  to  the  four  BI  key  scores.  .^0 
Need  Scores  and  12  Factor  Scores  were  obtained 
from  the  Actmitics  Index.  Al!  of  these  c  priori 
scores  were  cor:  elated  with  the  so’cn  external 
criteria  for  the  total  sample  of  645  trainees  in 
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'ftSBgaffTrrfrfc*  nc 


OTS 

Class 

OPT- 

SIE 

UPT- 

MEO 

OPT- 

FO 

UPT- 

MTO 

UPT- 

MOA 

OPT- 

Oth«r 

OTS- 

SiE 

OTS- 

MED 

OTS- 

MTO 

Dropout 

Subtotal 

SuccKt 

ToU! 

7008 

12 

5 

10 

0 

2 

0 

0 

0 

0 

29 

62 

91 

704)9 

19 

1 

24 

0 

0 

0 

0 

1 

6 

51 

150 

201 

Subsequent 

Gasses 

31 

13 

39 

0 

li 

0 

24 

IS 

4 

140 

0 

140 

Total 

62 

19 

73 

0 

13 

0 

24 

19 

10 

220 

2J2 

432 

^Scc  Tabic  1  'nr  definitions  of  the  alibrcvbtioni  used  as  the  coliuni.  hcadin)^. 


order  to  obtain  the  best  estimate  of  the  populatioii 
values  of  tlie  respective  vaiidiries.  Since  the  a  priori 
scores  we.e  not  constrncted  as  a  esult  of  iltm 
analvses  conducted  upon  the  sample  studied  in 
this  project  (ic.,  the  scoring  was  determined  prior 
to  this  project),  the  usual  concern  with  cross 
validation  was  iilready  satisfied. 

Constiuctiun  and  Cross 
Validation  of  New  Keys 

Table  2  presents  the  composition  of  the  fi»>t 
sample  on  which  keys  were  built,  described  n> 
tenns  of  both  the  OTS  class  number  from  which 
the  subjects  oiiginaJed  and  their  criterion  categoiy 
membership.  Also  presented  aic  subtotals  of 
successes  and  total  attrition  categories  on  the  right 
of  the  table.  The  key  bniiding  sample  was  made  up 
of  two-thirds  of  the  total  sample  studied  in  order 
to  stabilise  the  scoring  weiglits. 

Tiie  key  building  sample  was  select'd  in  a 
manner  s'milai  to  th.;ii  employed  in  stratified 
landom  sampling.  Since  the  ciiteria  to  be  predic¬ 
ted  were  citlier  coinhinations  of  two  or  more 
different  groups  into  dicliotomous  or  trichoto- 
nious  form  and  since  the  base  rates  as  well  as  tl:c 
absolute  si/.es  of  those  groups  were  relatively  tow. 
it  was  necessary  to  maintain  tiic  same  baj«  rates 
that  occurred  in  tlie  total  sample  in  both  the  key 
bufldinv  sainp'c  and  the  cross  validation  sample. 
Tliiis.  tl'.c  procedure  was  to  randomly  split  the 
succc.ss  group  and  each  attrition  group  into  the 
two-thirds  and  onc-ti:ird  subsainples  for  key 
bniiding  and  for  cross  validation  purposes, 
respectively. 

Table  2  ilinstratcs  how  all  of  the  successes  were 
selected  friun  OTS  -classes  70-0.S  and  70-G‘>.  while 
the  subjects  m.'iking  up  ihe  non-success  groups 
across  tl'.c  various  criteria  came  from  ail  OTS 
classes  70  05'  ihroiigli  70-1.''.  It  will  tx’  noticed  that 
the  namlrers  in  OTS  classes  70-08  and  70-09  were 
appro\n!i_teI\  crinal,  indicating  .sonic  consisleiicv 


in  the  success  rate  across  classes.  As  stated  previ¬ 
ously.  no  successes  were  included  in  OTS  classes 
70- 1 0  througl)  70-15  since  tlie  possibility  existed 
that  some  of  these  subjects  could  still  elect  to  drop 
out  or  would  be  washed  out  of  UPT.  As  indicated 
in  the  table,  the  key  building  sa  nple  size  of 
dropouts  plus  successes  was  432.  The  sums 
presented  at  the  bottom  of  the  tabic  illustrate  the 
sample  size  of  each  of  the  dropout  ■;ritcrion 
categories  or  groups.  l£vcn  though  the  attrition 
caicgoncs  were  experimentally  manipulated  to 
obtain  a  larger  number  of  subjects,  it  will  slBl  be 
noticed  that  the  absolute  sample  size  of  each  of 
the  attrition  calegories  was  smalt,  with  the  largest 
number  of  subjects  being  found  in  the  UPT-FD 
category  and  the  UPT-SIF.  category’.  AH  (T  the 
other  categories  by  themselves  were  far  too  small 
for  statistically  significant  relationships  to  be 
found,  as  will  be  illustrated  in  the  results  section. 
With  the  availability  of  additional  subjects  and 
passage  of  time,  these  sample  limitations  will  tend 
to  be  resolved  later  in  the  project. 

Table  3  lists  the  eleven  criteria  which  were 
included  in  tlie  first  cross  validation  of  Predictor 
Battery  A.  Also  included  in  the  table  is  a  notation 
indicating  which  criterie.  were  specifically  subject 
to  B1  key  building.  Criteria  1  tlirough  7  are  the 
external  criteria  which  were  based  upon  the  OTS 
and  UPT  .ittrition  groups  as  explained  in  Table  1. 
In  contrast.  Criteria  8,  9,  10.  and  11  arc  the 
internal  criteria. 

Criterion  8  was  a  Self-Rated  Lack  of  Dedication 
to  Complete  UIT.  It  should  be  noticed  by  tlie  way 
tlie  item  was  scored  and  named  that  a  higli  score 
ieflcct.nl  low  motivatiun.  Criicria  9.  10,  and  11 
were  all  factor  scores  taken  from  the  Activities 
Index.  These  measures  were  incUidcd  with  the 
hope  that  tlicy  would  help  K'  define  the  empirical 
keys  that  were  constnicted. 

Tiic  development  of  each  of  ihe  aforemen¬ 
tioned  keys  required  assessing  Ihe  relationships  of 
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Tai/e  j.  Criteria  and  Key  BuiMing 
Strategies  fcr  First  Cross  Validation 
of  Predictor  Battery  A 


Criterion 

Stialeay 

A* 

Strategy 

8** 

Extemrl  Criteria 
l.UPT-SIE=  l:Succcss  =  0; 
Other  =  Blank 

Key  huiti 

Key  built 

2.  UPT-n>=  I:Succc$s  =  0; 

Otiicr  =  blank 

Key  buiii 

No  key 

3.  OTS-SIE  or  t;PT-SIE  =  1; 
Success  =  0:  Other  =  blank 

Key  bai’*. 

Key  bust 

4.0frs-SlEorUPr-SIEoi 
OTSMTD  or  UPT-I-U  or 
UPT-MOA  =  1;  Success  =  0; 
Other  =  blank 

Key  built 

No  key 

£.  Total  Attrition  =  1 ; 

Success  =  0 

No  key 

No  key 

6.  OTS-SIE  =  2:  UPT-SIE  =  1 ; 
Success  =  0;  Other  =  blank 

Key  buiit 

Key  built 

7.  UPT-SIE  =  2:  OTS-SIE  =  1: 
Success  =  0:  Other  =  blank 

Key  bu3t 

Key  built 

Internal  Criteria 

8.  Setr-Rated  Lack  of  Dedication 
to  Complete  UPT 

No  key 

Key  bu3t 

9.  Actrrities  Index  Factor  Score 
IV  -  Motivation 

No  key 

Key  built 

to.  .Activities  Index  Factor  Score 
VII  -  Submtssivencss 

No  key 

Nokcv 

1 1.  Activilics  Index  Factor  Score 
XI  -  F.xprcs$i«:nc.<s 

No  key 

No  key 

*For  Stutcgy  A.  p  5* .04  and  >.2t. 

^ror  Strategy  B,  p^.OS  and  ^.24. 

each  item  alternative  to  each  criterion  through 
hberial  and  point-biserial  correlaticns.  Against 
some  criteria,  two  strategies  were  used  to  assess 
the  effects  of  these  different  standards  of  keying 
on  validity.  When  the  percentage  of  responses  was 
equal,  these  standards  were  as  foliows:  for 
Strategy  A  the  percentage  was  equal  to  or  greater 
than  4  peicent.  and  the  biserial  coriclation  was 
greater  or  equal  to  .21  (/r  >  .04  and  ^bis  ^ 
and  for  Strategy  B  the  percentage  ol  response  was 
equal  to  or  greater  than  5  percent,  and  the  biserial 
correlation  was  equal  to  or  greater  than  .24  {p  > 
.05  anJry^-^  >  .24).  Table  3  presents  the  key  build¬ 
ing  strategy  applied  to  each  of  the  eleven  criteria. 

Tltc  keying  itself  was  accomplished  by  weight¬ 
ing  aitcniaiivcs  which  met  tlie  require  J  standards 
plus  I  (+1)  for  positive  correlations  .<nd  minus  1 
(1)  for  negative  correlations  if  they  otherwise 
met  appropriate  standards.  TIicsc  prt*»cdurcs  were 
followed  in  order  to  examine  the  eoects  on  the 
cross  validation  of  tltc  developed  keyson  length  on 
the  one  hand  and  the  inclusion  of  itcii's  with  lower 


probabilities  of  response  and  lower  bisetial  coneia- 
tions  with  the  criteria  on  the  other  hand.  A  more 
c,xtensive  examination  into  these  effects  will  be 
pursued  in  later  stages  of  the  project  when  the 
effects  of  a  wider  range  of  standards  for  keying 
alternatives  on  validity  will  be  examined. 

Biographical  keys  to  predict  all  selected  criteria 
across  all  samples  were  generated  on  the  Univac 
1 108  at  the  University  of  Utah  Computer  Center. 
In  addition  to  the  Hem  keys  generated,  output 
from  the  program  included  for  each  selected 
criterion  within  each  sample,  the  percentage  of 
individuals  choosng  each  item  alternative,  and  the 
criterion  mean  for  those  individuals  who  selected 
each  alternative.  The  criterion  mean  for  dichoto¬ 
mous  criteria  is  directly  interpretable  as  the 
proportion  of  persons  in  each  criterion  category. 
The  program  also  provides  the  biscrial  arrd  point- 
biserial  correlations  of  each  item  alternative  with 
each  criterion  and  the  standard  errors  for  those 
biserials,  together  with  the  eta  coefficient  for  the 
total  item  continuum  with  each  criterion  and  the 
standard  error  of  the  eta. 

In  consiructing  a  biographical  scoring  key  to 
predict  an  outside  criterion,  the  emphasis  is 
usuaOy  placed  on  obtaining  a  very  high  cross 
validity  coefficient  for  the  key  ;n  predicting  that 
criterion  on  an  independent  smiple.  This  in  turn  is 
a  lunction  of  at  Ic.ist  four  parameters;  (o)  nuntber 
of  Items  keyed;  (b)  the  magnitude  of  the  correla¬ 
tions  of  individual  item  altcrnrtivcs  with  tltc 
criterion:  (c)  the  expected  stability  of  the  item 
alternative-criterion  correlation  which  in  turn 
varies  with  the  significance  level;  and  (</)  item 
heterogeneity. 

Tlie  scoring  stratgcgics  based  on  the  standards 
utili/.cd  as  described  were  selected  ns  those  which 
would  come  close  to  obtaining  the  desired  balance 
across  the  item  selection  parameters.  That  is.  a 
sufficient  number  of  items  would  be  scored,  high 
item-criterion  correlations  would  be  selected 
which  would  yield  high  :cliability.and  because  the 
lumber  of  items  selected  would  be  large,  seme 
item  heterogeneity  would  also  be  obtained. 

Following  their  dcvelopiiicnt.  the  fourteen  new 
scoring  keys  were  used  to  score  thi.  item  responses 
of  all  the  subjects  in  the  first  cross  validation 
sampl-  described  in  Table  4.  This  cross  validation 
sample  is  made  up  of  those  subjects  vvho  were  nor 
in  the  key  building  sample.  Also  the  percentage  of 
persons  in  each  of  the  various  criterion  groups  is 
nearly  identical  to  those  in  the  key  building 
sample.  The  reason  for  this  split-s.imple  metliod  of 
analysis  vvas  that  tire  use  of  the  same  group  for 
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Table  4.  Distribution  of  Cross  Validation  Sample  Across  Success  and  Attrition  Categories 


OTS 

aau 

UI»T- 

SIE 

UPT- 

MEO 

UKT- 

FO 

UPT- 

IMTO 

UPT- 

MOA 

OPT* 

OthtT 

OTS- 

SIE 

OTS- 

MEO 

OTS- 

ft*TD 

Dropout 

Subtotal 

Succett 

ToUl 

70-08 

7 

0 

4 

0 

0 

0 

0 

0 

0 

11 

35 

46 

704)9 

10 

2 

10 

0 

G 

0 

2 

1 

0 

25 

73 

98 

Subsequent 

Gasses 

13 

7 

21 

0 

6 

0 

o 

9 

3 

68 

0 

68 

Total 

30 

9 

35 

0 

6 

0 

n 

10 

3 

104 

108 

212 

both  the  deveior  nent  of  the  scoring  weights  and 
the  application  of  these  weights  always  produces 
results  which  arc  spit  rusly  high  and  thus  fails  to 
give  an  accurate  cst*..iate  of  the  effectiveness  of 
the  instrument.  Cross  validation  of  tlie  scoring 
keys  on  a  'eparate  sample  provides  an  estimate  of 
the  effectiveness  of  die  procedure  on  another 
independent  group. 

Analysis  of  the  UPT-SIE 
Criterion  Group 

An  analysis  of  the  UPT-SIE  criterion  group 
entailed  a  categorization  ot  SlEs  on  two  dimen¬ 
sions.  The  first  dimension  considered  was  phase  of 
training  in  which  the  student  attrited.  This  phase 
was  broken  down  into  three  parts  including  the 
T-4 1  phase,  the  T-37  phase,  and  the  T-38  phase. 
The  second  dimension  was  the  expressed  primary 
reason  for  attriting  as  determined  by  a  reading  of 
the  Faculty  Board  Proceedings.  A  classification 
system  was  developed  on  the  basis  ol  a  previous 
examination  of  the  Faculty  Board  Proceedings  of 
SlEs  from  fiscal  year  1969.  The  possible  reasons 
for  voluntarily  attriting  included  dislike  of  flying, 
lack  ot  desire  to  fly,  apprehension,  tension,  occur- 
reocc  of  nau%-a  iri  flight,  entry  for  commission 
only,  lack  of  career  relevancy,  felt  lack  of  skiQ, 
family  pressures,  conscientious  objcctioti,  threat  of 
draft,  reduction  of  service  commitment,  discon¬ 
tent  with  the  Air  Force,  depressing  effect  of  UPT, 
and  felt  lack  of  dedication. 

The  breakdown  of  types  of  SlEs  was  intended 
to  provide  son.-e  prcliminaiy  information  on  tlic 
possibOity  of  examining  differential  predictability 
of  criteria  based  upon  subdivision  of  the  SIE 
attrition  group.  The  actual  attempt  to  examine 
differential  predictability  was  not  made,  however, 
because  of  the  relative!}'  small  size  of  the 
subf  '  :os  created  by  dissecting  the  SIE  attrition 
gro!'.'  ‘t  was  felt  that  si^aiificant  differences  in 
reaSi  c  for  voluntary  elimination  between  differ¬ 
ent  phases  of  training  may  suggest  the  possibility 
of  differential  prcdiciability. 


V.  RESULTS 

This  seciion  presents  Lhe  results  obtained  in  the 
first  year  of  data  collection.  Tliese  wiQ  include 
validation  of  a  priori  scores,  cross  validation  of 
Biographical  Inventory  keys,  utility,  and  subcate- 
gorteation  of  UPT-SIE.  When  reading  the  validities 
pre-sented  in  the  tables,  it  is  important  to  note  that 
a  positive  validity  obtaiiicd  against  an  attrition 
criterion  indicates  that  a  person  rece'ving  a  high 
score  OP  the  predictor  was  more  likely  classified  as 
a  dropout.  On  the  other  hand,  a  negative  validity 
obtained  against  an  attrition  criterion  indicates 
that  a  person  receiving  a  high  score  on  the 
predictor  was  mere  likely  to  be  a  successful 
trainee.  These  indications  were  due  to  the  neces¬ 
sarily  arbitrary  nature  of  assigning  direcfioiiality  to 
criterion  measures  through  tlie  numerical  scale 
values  applied  to  the  attrition  group  and  the 
success  gioup  (Le.,  the  sign  of  the  validity  was 
determined  by  the  decision  to  code  dropouts  as 
the  higher  number,  1  or  2.  and  successes  as  the 
lower  number,  0). 

Validation  of  A  Priori  Scor« 

The  validities  of  the  a  priori  scores,  presented  in 
Table  5,  were  based  upon  the  total  sample  used  in 
the  first  cross  validation  of  Predictor  Battery  A. 
Since  there  were  a  priori  scores,  it  was  not  neces¬ 
sary  to  use  a  hold-out  cross  validation  sample  to 
assess  the  predictive  value  of  these  scores.  Because 
tlie  criterion  scores  ware  based  upon  various  attri¬ 
tion  groups  and  some  groups  were  treated  as 
missing  data,  the  sample  size  fur  each  correlation 
depended  upon  the  criterion  used.  Tne  minimum 
number  of  subjects  for  each  correlation  was  41-i. 
Tlius.  the  minimum  number  of  degrees  of  freedom 
in  calculating  significance  levels  was  4 1 2. 

Table  5  indudes  the  validities  of  the  a  priori  B1 
key  scores  and  the  Activities  Index  scores  against 
the  seven  external  criteria  (see  Table  3)  used  in  the 
first  cross  validation  for  Predictor  Battery  A.  Tlie 
primary  criterion  (UPT-SIE  =  1 :  success  =  0:  others 
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=  blank)  is  Cntorion  1,  and  Cnteria  1,  3,  6,  and  7 
arc  constructed  from  l)PT-S«Es  cniy  or  from 
OTS-SIEs  or.ly.  or  from  UPT  and  OTS  SlEs, 
together  with  a  contrastini;  success  group.  The  first 
four  predictors  were  a  priori  keys  from  the  BI  and 
included  the  Motivation  key,  the  Creativity  key, 
the  Academic  Performance  key.  and  the  Leader¬ 
ship  key.  Ti.a  Creativity  key  had  two  significant 
validities  against  external  criteria.  However,  these 
were  very  small  (-  10  and  -.11),  although  signifi¬ 
cant  beyond  the  .05  Irvtl.  Since  all  the  criterion 
measuivs  were  scaled  to  identify  SIE  as  higli  and 
success  as  low,  the  negative  correlations  indicated 
a  veiy  slight  tcndciuy  for  those  wiio  eliminate 
themselves  to  be  very  slightly  below  average  on  the 
Creativity  .score  of  the  BI. 

The  next  30  predictors  were  the  existing  need 
scores  derived  from  the  Activities  Index.  Again, 
the  magnitudes  of  the  validities  obtained  were 
small.  The  most  valid  predictor  among  these  need 
scores  v.as  the  Harm  Avoidance  Need  Score  which 
correlated  positively  beyond  the  .01  level  of 
significance  with  six  of  the  seven  external  criteria, 
a  meaningful  finding  differentiating  dropouts  from 
successes.  Tlic  second  best  predictor  among  the 
need  score.<  was  the  Energy  Need  Score  which 
coirclated  negatively  beyond  the  .05  level  of 
significance  with  five  external  critcri?,  again  with 
the  meaning  that  the  dropouts  have  less  energy. 
Other  need  .scoies  which  correlated  significantly 
and  in  meaningful  directions  with  some  of  the 
external  criteria  included  Change,  Exhibitionism, 
Play,  Science,  Sensuality,  ano’  Supplication.  All  of 
these  SCOT'S  conclatcd  negatively  with  the  attri¬ 
tion  criteria,  except  the  Supplication  Need  Scor; 
which  had  a  positive  rclation^ip. 

The  final  12  predictors  listed  in  Tabic  5  include 
«he  12  Factor  Scores  derived  fiom  the  Activities 
Index.  Significant  validities  were  oblaincd  for  only 
two  of  these  twelve  Factor  Scores  against  the 
axtemal  criteria.  Audacity  correlated  ncg.aiivcly 
with  five  of  the  seven  external  criteria  beyond  the 
.01  level  of  ^gnificancc.  and  with  six  of  the  seven 
cxiema]  criteria  beyond  the  .05  level  of  sisntfi- 
cance,  suggesting  that  dropouts  from  flying 
training  arc  less  audacious.  Motivation  correlated 
negatively,  as  expected,  with  two  of  the  external 
criteria  beyond  the  .05  level  of  significance.  Tic: 
number  f  significant  validities  obtained  against 
each  of  ..u  seven  external  criteria  is  shown  at  the 
bottom  of  Table  5.  It  is  noteworthy  that  the  most 
predictable  criteria  were  those  v.hich  included  the 
UPT-SIE  attrition  group.  Tltis  is  csidcncc  that  the 
predictors  '.w/c  appropnately  selected,  since  they 
hit  the  dropout  criteria  most  relevant  to  the 


purpose  of  the  study.  The  single  most  predictable 
criterion  was  Criterion  C  which  was  purposefully 
scaled  to  tcflcct  an  underlying  motivational  con¬ 
tinuum  dealing  with  the  motivation  to  continue  in 
OTS  and  UPT. 

Cross  Validaticn  of  Biographical 
Inventory  Keys 

Table  6  presents  the  criterion  intercorrelations 
for  tlie  first  cross  validation  sample  of  Predii  .c; 
Battery  A  The  sample  size  appropriate  for  t*. 
correlation  is  presented  above  the  diagonal  in  t..is 
matrtx.  The  :3mple  size  varied  depending  upon  the 
number  of  people  in  each  attrition  group.  The 
mean  of  the  dichotomous  criterion  measures 
indicates  the  percentage  of  failures,  or  the  experi¬ 
mental  base  rate  in  the  cross  validation  sample. 
The  percentage  of  successes  would  simply  be  1 .00 
rr.inus  the  percentage  of  failures.  Base  latrs  for  the 
nichotomous  criterion  mea.<aires  were  not  directly 
obtainable  fiom.  tlie  criterion  mcas.s,  since  the 
differential  weighting  of  the  dropout  groups 
obliterated  interpretations  in  terms  of  percentages. 
The  intcrcorrclatioiis  of  the  externa!  criteria  which 
appear  in  the  upper  left  segment  of  the  intercor- 
rclation  portion  of  the  matrix  wcie  ptimarily 
dependent  upon  part-whole  lelationships  and  the 
various  weighting  strategics.  With  the  exception  of 
the  Sclf-Patcd  Lack  of  Dedication  to  Complete 
UPT,  the  four  internal  criteria  in  the  lower 
segment  of  the  table  did  not  correlate  highly  with 
the  seven  external  criteria. 

The  valtdiiics  obtained  under  Strategy  \(p> 
.04  and  .21)  are  presented  in  Tabic  7  with 
the  criteria  as  rows  and  the  empirical  key  scores  as 
columns.  Each  key  is  numbered  according  to  the 
criterion  it  was  developed  to  predict:  i.c.,  in 
Strategy  A,  the  keys  were  developed  to  predict 
Crf  -1.2,  3, 4,  6.  and  7,  respectively.  Reading 
ac’^oss  a  row  indicates  how  wcU  a  particular 
criterion  was  predicted  by  the  empirical  keys, 
while  leading  down  a  column  indicates  how  effec¬ 
tive  a  particular  key  was  in  predicting  the  various 
criteria. 

Criterion  1,  which  was  the  primary  UPT-SIE 
criterion,  was  predictable  from  five  of  the  six  key 
scores  beyond  the  .01  level  of  significance.  Three 
of  these  key  scores  (numbers  1.  6.  and  7) 
produced  identical  validities  of  .32.  Criterion  2 
•  UPT-FD  =  1:  success  ■=  0.  other  =  blank),  a 
dropout  critcritm  not  directly  focused  upon  in  this 
study,  was  predictable  beyond  the  .05  level  of 
significance  with  kev  number  6.  which  was  •  cvcl- 
oped  to  predict  one  of  the  continuously  scaled  SIE 
criteria.  Tlic  combined  dichotomous  SIE  ciitcrion. 
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Criterion  3,  made  up  of  the  OTS-SIE  group,  the 
UPT-SIE  group,  and  the  success  group,  was 
predictable  with  six  out  of  six  keys  beyond  the  .05 
level  of  significance,  and  five  of  these  validities 
were  also  significant '  eyond  the  .01  level. 

Criteria  4  and  5,  which  differ  primarily  in  that 
medical  eliminees  were  included  in  Criterion  5  but 
not  in  Criterion  4,  indicated  that  medical  eliminees 
may  have  indeed  decreased  sligiitly  the  predicta¬ 
bility  of  Total  Attrition.  Although  there  were  not 
significant  differences  between  the  validities 
obtained  for  these  two  criteria  with  given  keys, 
there  were  nonetheless  sliglit  consistent  drops  in 
validities  ranging  from  .01  to  .03. 

The  trichoiomous  versions  of  the  SIE  criteria,  6 
and  7,  produced  13  out  of  14  validities  significant 
beyond  the  .01  level  and  14  validities  significant 
beyond  the  .05  level.  Criterion  f'.  which  gave 
OTS-SIE  the  higlicst  wciglit,  was  more  predictable 
in  all  cases.  The  differences  in  predictability 
obtained  against  tlicse  two  criteria  from  a  given 
key  ranged  from  .04  to  .09. 

Tlic  validities  of  the  six  key  scores  against 
iiitemal  Criteria  8  and  9  indicate  that  some 
motivational  component  was  included  in  all  keys.^ 
Very  high  correlations  ranging  from  .38  to  .71 
were  obtained  from  all  key  scores  in  predicting 
Self-Rated  Lack  of  Dedication  t.*'  Complete  UPT. 
Correlations  between  the  key  scores  and  the 
Activities  Index  Factor  Score  on  Motivation  were 
also  all  significant  beyond  the  .01  level  and  ranged 
from  -.35  to  -.46.  Factor  Scores  for  Submissivcncss 
and  Expressiveness  were  not  related  to  any  of 
these  six  key  scores. 

The  keys  that  were  generally  most  effective 
(numbers  1,  3,  6,  and  7)  all  emphasized  the  SIE 
attrition  groups.  Key  number  6,  developed  to 
predict  one  of  the  continuously  scaled  types  of 
dropout  measures,  was  the  most  effective  key;  its 
generality  against  both  internal  and  external 
measures  provided  some  evidence  that  the  key  was 
concerned  with  motivational  constructs  related  »o 
commilinenS  to  an  Air  Force  flying  career. 

Table  8  presents  the  intercorrclations  of  the 
empirical  key  scores  obtained  using  Stralcg>'  A  (/> 
>  .04  and  rj,;j  >  .2'.)  it  will  be  noted  that  the 
inlcrcorrolations  of  tiic  five  keys  built  to  predict 
various  SIE  criteria  ranged  from  .9?  to  .98.  The 
other  (sixth)  key  built  to  predict  Criterion  2 
(UPT-FD  “  1 ;  success  =  0;  other  =  hiank)  corre- 

■'Hic  v;i]iditicx  produced  ttic  interna]  criteria 

were  all  eoiuiirrent  in  nature,  w'.ile  die  va1iditir.c  pro 
diiccd  against  die  e\ternal  criteria  wer-  all  predictive. 


lated  between  .61  and  .67  with  the  above  five 
keys.  Tliese  high  intercorrclations  indicate  that 
those  people  who  belonged  to  the  various  criterion 
groups,  or  attrition  groups,  were  somewhat  similar 
and  in  some  cases  highly  similar  in  terms  of  their 
life  history  antecedents  and  self-perceptions. 

Table  9  presents  the  cross  validities  obtained 
from  the  keys  built  under  Strategy  B(p>  .05  and 
^bis  ^  --'*)■  Again,  six  keys  were  constructed  and 
numbeicd  in  accordance  with  the  criterion  they 
were  developed  to  predict.  The  first  four  of  these 
keys  were  constructed  against  external  criteria, 
and  the  other  two  were  constructed  against 
interna!  criteria.  Among  the  seven  external  criteria, 
only  Criterion  2  was  not  predicted  beyond  the  .01 
level  of  significance.  Tlie  validities  obtained  against 
the  primary  UPT-SIE  criterion,  Criterion  1, 
demonstrated  the  advantage  of  applying  a  number 
of  keys  built  on  different  criteria  to  the  primary 
criterion,  it  should  be  uoted  that  the  primary 
UPT-SIE  criterion  was  predicted  at  an  equal  or 
higher  level  by  all  four  of  the  keys  built  against 
other  external  criteria  than  it  was  by  its  own  key. 
Criterion  6  was  the  most  predictable  SIE  criterion. 
A  validity  of  .42  was  obtained  in  predicting  this 
criterion  from  the  key  built  to  predict  Self-Rated 
Lack  of  Dedication  to  Complete  UPT.  The  key 
built  specifically  to  predict  Criterion  6  produced  a 
cross  validity  of  .41. 

These  results  again  indicate  some  underlying 
motivational  components  in  the  criterion  and 
empirical  keys.  It  is  of  particular  interest  to  note 
that  even  thougli  the  motivational  score  from  the 
Activities  Index  had  very  limited  validity  in 
predicting  the  various  SIE  criteria,  the  Bl  key 
constructed  to  parallel  this  internal  criterion  had  a 
higher  pattern  of  correlations.  This  was  evidenby  a 
function  of  the  empirical  key  being  compesed  of 
items  that  were  more  relevant  to  the  SIE-bascd 
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criteria  and  is  indicative  of  the  complexity  of  the 
total  motivational  area. 


Tlic  patterns  of  validities  obtaineu  against  the 
external  criteria  sugge'sted  that  criteria  which 
included  attrition  groups  other  than  OTS-SIE  or 
UlT-SIE  were  less  predictable  than  those  which 
included  only  OIS-SIE  or  UPT-SIE.  Tlic  indica¬ 
tion  was  that  the  goal  of  constructing  and  selecting 
a  battery  of  items  which  would  be  best  able  to 
predict  SlE-based  criteria  had  been  approached. 
Tliis  was  to  be  expected  since  no  explicit  attempt 
had  been  m.ide  to  tap  dimensions  relating  to  other 
attrition  groups  through  biographical  items  in  the 
test  construction  phase. 


Tables.  ValiditiM  of  A  Priori  Bl  KoyScort*  and  Activities  index  Scores 


Viadictor 

Mean  SD 

Number 

ol 

Items 

1 

2 

Crtlarion 

3  4 

5 

c 

7 

Number 

Sitn'ficanI 

Amont? 

Criteria 

BlScoiei 

Motivation  Key 

104.53  330 

45 

-.06 

.02 

-.08 

-.02 

-.03 

-.09 

-.07 

0 

Creativity  Key 

99.70  6.11 

51 

-.03 

-.08 

-.08 

-.08 

-.10* 

-.11* 

-.05 

2 

Academic  Key 

104.01  936 

51 

31 

-.02 

-.03 

-.03 

-.03 

-37 

-.01 

0 

Leadeiship  Key 

10831  330 

26 

-32 

-38 

-.06 

-.06 

-.0? 

-.t'3 

0 

Acfviies  Index  Need  Scoses 

Abasement 

3.67  1.73 

10 

-37 

-.10* 

-.04 

-.06 

-.05 

.00 

-.06 

1 

Achievement 

7.00  2.08 

10 

-.03 

.02 

-.OS 

-.01 

-33 

-.07 

-.04 

0 

Adaptabihy 

534  2.22 

10 

.01 

-.05 

.00 

-.03 

-.03 

-31 

.01 

0 

Aflifiation 

7.09  ^34 

10 

-.04 

.02 

-.04 

-.02 

-.02 

-.04 

-.04 

0 

Aggression 

433  2.19 

10 

-.02 

-.02 

-.03 

-.04 

-.03 

-.04 

-.03 

0 

Change 

5.93  2.14 

10 

-.03 

-36 

-.08 

-39* 

-.09* 

-.11* 

-.05 

3 

Coqjunctivity 

6.46  1.96 

10 

.02 

.03 

.03 

.06 

35 

.03 

.02 

0 

Counteraction 

7.17  2.1S 

10 

-37 

-.04 

-.03 

-.07 

-.08 

-.08 

-.08 

0 

Deference 

7.40  1.76 

10 

-36 

-.03 

-.06 

-.04 

-33 

-35 

-.06 

0 

Dominance 

735  1.71 

10 

-.03 

.00 

-.02 

-.02 

-.02 

-31 

-.03 

0 

Acinevement 

630  236 

10 

-.05 

-.01 

-.04 

-.03 

-.04 

-.02 

-.04 

0 

Emotionafity 

3.91  1.71 

10 

-31 

-.06 

-.02 

-.04 

-.05 

-33 

-.02 

0 

Energy 

7.35  135 

10 

-.10* 

-32 

-.14** 

-.08 

-.09* 

-.16** 

-.12* 

5 

Exhibitionnm 

4.73  2.61 

10 

-.06 

-.01 

-.09 

-.06 

-37 

-.10* 

-.08 

1 

Fantaaed  Actnevement 

435  230 

10 

-.10* 

-.01 

-.09 

-.07 

-.07 

-.07 

-.09 

1 

Harm  Avtridance 

3.43  234 

10 

.18** 

.09 

.18** 

.17** 

.17** 

.16** 

.18** 

6 

Humatiities,  Social  Sciences 

6.46  2.72 

10 

.04 

.07 

.06 

.08 

.06 

38 

.05 

0 

Impulavencss 

5.47  1.74 

10 

-.01 

.02 

-.01 

-.01 

-.01 

.00 

-.01 

0 

Narcissitm 

4.98  2.36 

10 

-.04 

-.03 

-.02 

-.04 

-.03 

.00 

-33 

0 

Nurturance 

731  231 

10 

-.04 

-.02 

-31 

-32 

-.02 

.01 

-.03 

0 

Otgectivity 

8.86  1.2/ 

10 

34 

.02 

-.01 

.00 

-.01 

-.05 

.02 

0 

Order 

4.97  3.21 

10 

-.03 

.04 

-.04 

.02 

.02 

-.05 

-.04 

0 

Play 

531  2.31 

10 

.01 

-.10* 

-.03 

-.10* 

-.10* 

-.06 

-.01 

3 

Practicalness 

7.39  2.14 

10 

-.09 

-.03 

-.06 

-.05 

-.05 

-.03 

-.08 

0 

Reflectiveness 

7.07  2.00 

10 

-.02 

-.04 

.04 

-.01 

-.02 

.07 

.00 

0 

Science 

7.66  2.65 

10 

-.10» 

-.06 

-.07 

-.08 

-.08 

-34 

-.09 

1 

SensuaEty 

5.17  1.90 

10 

-.11» 

-.04 

-.09 

-  09* 

-.09* 

-.07 

-.10* 

4 

Sexuality 

4.88  2.44 

10 

.00 

-.02 

.00 

-.02 

-.01 

.01 

.00 

0 

Supplication 

6.45  1.91 

10 

38 

-.01 

.11* 

36 

3C 

.12* 

.09 

2 

Understanding 

3.99  1.15 

10 

-.05 

.00 

-.03 

-.02 

-.04 

30 

-.04 

0 

Activities  Index  Factor  Scores 

Self-Asseition 

23.74  6.69 

40 

-.09 

-.01 

-.09 

-37 

-.07 

-.07 

-.09 

0 

Audacity 

2331  5.80 

40 

-.17»» 

-.07 

-.15** 

-.14** 

-.14** 

-.12* 

-.16** 

6 

Intdlectual 

25.18  6.64 

40 

-34 

-.01 

.01 

-.01 

-.02 

.04 

-.02 

0 

Motivation 

2531  536 

40 

-.08 

-.02 

-.10* 

-.06 

-.08 

-.1 1* 

-.09 

2 

Applied  Interests 

20.03  6.02 

30 

-.09 

-.01 

-.08 

-.04 

-.04 

-.05 

-.09 

0 

Orderliness 

20.03  633 

40 

.00 

34 

.01 

.06 

.06 

*12 

.01 

0 

Submbsivcncss 

23.82  5.39 

40 

-.05 

-.07 

-.04 

-.05 

-.05 

-.02 

-.05 

0 

Closeness 

25.94  5.64 

40 

-.01 

-.03 

31 

-.01 

.00 

.03 

.00 

0 

Sensuousness 

15.02  5.21 

30 

-.06 

-.04 

-.04 

-.06 

-.05 

-.02 

-.05 

0 

Friendliness 

1X61  3.61 

20 

-.02 

-.05 

-.05 

-.07 

-.08 

-.07 

-.03 

0 

Expressiveness 

1930  535 

40 

-.04 

-.02 

-.05 

-.05 

-.05 

-.05 

-.W 

0 

I^ism 

10.97  4.71 

30 

-.08 

-.02 

-.05 

-.05 

-.05 

-.02 

-.07 

0 

N  per  Column 

412 

428 

447 

587 

644 

447 

447 

Number  Significant 

Among  46  Predictors 

6 

2 

5 

5 

7 

8 

4 

*Signi&c4nt  bryond  .05  Icvd. 

**Stsni(icant  beyond  .01  kvcL 

^hc  iVs  vary  xt  a  function  in  the  number  of  indhiduali  in  each  criterion  group  at  presented  in  Table  1. 
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Table?.  Cross  V^idities  of  thtStrstagy  A  Key  Scoa  In  Predicting  External 
and  Internal  CrHerki.  Battaty  A  Analysis* 


External  Cntena 

1. UPT-SIE=l:  Success  =  0: 

Other  =  b]ai& 

2.  UPT-FD  =  1;  Success  =  0; 

Other  =  Uank 

3.  OTS-SIE  or  UPT-SIE  =  1; 

Success  =  0:  Other  = 

Uank 

4.  OTS-SIE  or  UPT-SIE  or 

OTS-MTD  or  UPT-FD 
orUPT-MOA  =  l;. 

Success  =  0;  Other  = 

Uank 

5.  Total  Attrition  =  1; 

Success  =  0;  Other  = 
blank 

6.  OTS-SIE  =  2:  UPT-SIE  =  1; 

Success  <=  0;  Other  = 
blank 

7.  UPT-SIE  =  2:  OTS-SIE  =  1: 

Success  =  0;  Other  = 

Uank  I 

Internal  Ottetia 

8.  Self-Rated  Lade  of  Dedication 
i  to  Complete  UPT 

9.  Actmties  Index  Factor 

Score  IV  -  Motivation 

10.  Actmties  Index  Factor 

Score  VII  •  Submisnveness 

11.  Activity  Index  Factor 

Score  XI  -  Expressveness 

Number  Signilkant 
Amone  1 1  Criteria 


Corrotation  MtwMn  CriMiton 
and  Kay  Scorn 


.32** 

.14 

.30** 

.24** 

.32** 

J2»* 

137 

.15 

.12 

.16 

.12 

.18* 

.15 

142 

.36»* 

.20* 

.37** 

.31** 

.39»* 

31*» 

148 

J9** 

.21** 

.29** 

.24** 

21** 

.30** 

192 

26** 

.20** 

21** 

21** 

.29** 

.28** 

212 

.36** 

.23** 

29** 

.33** 

.42** 

.38** 

148 

.32‘* 

.16* 

.31** 

.26** 

.33** 

22** 

148 

.68** 

.38»* 

.72** 

.70** 

.71** 

.71** 

212 

-.38** 

-.35** 

-.44** 

-.43** 

-.46** 

-.40** 

211 

-.04 

-.05 

-.07 

-.07 

-.07 

-.07 

211 

-.08 

-.05 

-.06 

-.08 

-.07 

-.08 

211 

8 

7 

8 

8 

9 

8 

Alccmathres  keyed  when  p  a 
'Significant  beyond  .05  leveL 
'Si^Gcant  beyond  .01  leveL 


^.04  and  n,:-  ^.21. 


Sttnlflcanl 

AmonfS 

Scons 


Tables.  IntercorrelationsofBattery  A  Empirical  Ksy  Scores 
For  Cross  Validation  Sample.  Strategy  A* 

(N  =  2t2) 


iQWfcoTreutlon 

Number 

Kay  Scon 

1 

3  3  4  S 

7 

Maan 

SO 

of 

Ittms 

1.  UfT-SIE  =  1 ;  Success  =  0;  Other  =  blank 

2.  UPT-FD  =  I ;  Success  -  0;  Otixr  =  blank 

3.  OTS-SIE  or  UPT-SIE  =  1 :  Success  =  0; 

Other  =  Uank 

4.  OTS-SIE  or  UPT-SIE  or  OTSAITD  or 

UPT-FD  or  UPT-MOA  =  l:Succcs$  = 
0;  Other  =  blank 

6.  OTS-SIE  =  2:  UPT-SIE  =  1 :  Success  = 

0:  Other  =  Uank 

7.  UPT-SIE  =  2;OTS-SIE_=  ItSuccess  = 

0;  Other  =  blank 


Altemaiives  keyed  when  p  ^.04  and 


^1*-*  s.V'  '%'*»'5»^> ' 


Table  9.  Cross  Validities  of  the  Strategy  B  Key  Scores  hi  Pi^dicitng 
External  and  Internal  Criteria,  Battery  A  Analysis* 


Number 

Conctatton  between  Criterion 

Sisniilcant 

and  Key  Score 

Amons  S 

Criterion  1 

3 

7 

k  - 

i 

N 

Scores 

Extenal  Ciiteiia 

l.UIT-SIE=  1:  Success  =  0: 

Other  =  blank  .29** 

.31" 

.31" 

.29** 

.30** 

-.19* 

137 

6 

2.  UPT*FD  =  1:  Success  =  0; 

Other  =  blank  .12 

.14 

.17* 

.13 

.12 

-.05 

152 

1 

3.  OTS-SIE  or  UPT-SIE  =  1 ; 

Success  ==  0:  Other  =  blank  .33** 

.36" 

.38** 

.33** 

.38** 

-.28" 

148 

6 

4.  OTS-SIE  or  UPT^IE  or  OTS-MTD 

or  UPT-FD  or  UPT-MOA  =  1 ; 

Success  =  0;  Other  =  blank  .26** 

.28" 

.30** 

.26** 

.26" 

-.17* 

192 

6 

5.  Totai  Attrition  =  I ;  Success  = 

0;  Other  =  blank  .24** 

.27" 

.27** 

.24** 

.24** 

-.14* 

212 

6 

6.  OTS-SIE  =  2;  UPT-SIE  =  1 ; 

Success  =  0:  Other  =  blank  .33** 

.38" 

.41** 

.34*  • 

.42** 

-.31** 

148 

6 

7.UPT^IE=2;OTS-SIE=l: 

Success  =  0;  Other  =  blank  J9** 

.31" 

.32** 

.29" 

.32** 

-.22** 

148 

6 

Intemal  Criteria 

8.  Self-Rated  Lade  of  Dedication 

to  Complete  UPT  .68** 

.73" 

.73** 

.70** 

.72** 

-.63** 

212 

6 

9,  Activities  Index  Factor  Score 

IV  •  MotivatiiMi  -.35** 

-.40"  - 

-.46** 

-.36** 

-.51** 

.62** 

211 

6 

10.  Activities  Index  Factor  Score 

VII  •  Submissiveness  -.01 

-.06 

-.10 

-.02 

-.12 

.16* 

211 

1 

11.  Activities  Index  Factor  Score 

XI  -  Expressiveness  -.07 

-.07 

-.05 

-.06 

-.10 

.02 

2II 

0 

Number  Signifleant 

Among  11  Criteria  8 

8 

9 

8 

8 

8 

“Alternatives  keyed  when  p  >.0S  and  r^ 
'Significant  beyond  the  .05  leveL 
"Significant  beyond  the  .01  level. 

>.24. 

Table  10.  Intercorrclations  of  Battery  A  Empirical  Key  Sooret 

for  Cross  Validation  Sample,  Strategy  B* 

(b'=2l2} 

Intereorreiation 

Number 

or 

Items 

Key  Score 

1  3 

c 

7 

a  9 

Mean 

SO 

l.UPT«E  =  l;  Success  =  0; 

Others  blank 

3.  UPT-SIE  or  OTS^IIE  =  I;Succes$  = 

- 

93.59 

8.94 

58 

0;  Other  =  blank 

.97 

88.52 

12.13 

76 

6.  OTS-SIE  =  2;  UPT-SIE  =  1 :  Success  = 

0;  Other  =  blank 

.92  .97 

- 

(.7.71 

13.29 

92 

7.  UPT-SIE  =  2;  OTS^IE  =  1;  Success  = 

0;  Other  =  blank 

.99  .98 

.94 

- 

91.61 

0i9 

58 

8.  Self-Rated  Lack  of  Dedication  to 

Complete  UPT 

.87  .93 

.93 

.89 

- 

76.94 

26.81 

149 

9.  Activities  Index  Factor  Seme  IV  - 

Mothratian 

-.73  -.79 

-.84 

-.75 

-.91 

1 19.49 

23.73 

165 

“Alternatives keyed  whcnp  ^.05  and  f|,jj >.24. 


20 


? 

a 


Table  11.  Cnm  Validities  of  One 
Subscore  of  Existing  Air  Force  Pilot 
Biographical  Inventory  and  Officer 
Biographical  Inventory  Items* 


Table  12.  Different  Types  of  SIEs 
for  Three  Phases  of  Training 


Crtttrion 

Cross 

VaUdity 

SampI* 

SIM 

Extemil  Criteria 

I.  UPT-SIE  =  l;Success  =  0; 

Other  =  biaiik 

137 

2.  UPT-FD  =  1;  Success  =  0; 

Other  =  btank 

-15 

142 

3.  OTS-SIE  or  UPT-SIE  =1; 

Success  =  0;  Other  =  blank 

.30** 

148 

4.  OTS-SIE  or  UPT-SIE  or  OTS- 
MTD  or  UPTMOA  =  I :  Success 
=  0:  Other  =  blank 

.25** 

192 

S.  Total  Attrition  =  1:  Success  =  0 

.22** 

212 

6.  OTS-SIE  =  2;  UPT-SIE  =  I; 

Success  -  0;  Other  =  blaiik 

.33" 

148 

7.  UFT-SIE  =  2;  OTS-SIE  =  I : 

Success  =  0:  Other  =  blank 

JS** 

148 

Inienui  Criteria 

8.  Self-Rated  Lade  of  Dedication  to 
Complete  UPT 

.S2*» 

212 

9.  Actiritki  Index  Factor  Score  IV- 
Motivation 

-.43** 

211 

10.  Activities  Index  Factor  Score  VII- 
Submisriveness 

-.11 

211 

1 1.  Activities  Index  Factor  Score  XI- 
Expresshencss 

-.04 

211 

Reason  for  Solf- 
Initlalcd  EtlmliuUon 

NumMr  for 
Trainlod  Rliasa 

T-4I  T-37  T-aa 
Pliaso  PtuM  niaso 

Dislike  of  flying 

9 

16 

1 

No  desire;  to  fly 

23 

17 

1 

Apprehension 

27 

23 

1 

TenricMi 

11 

7 

Nausea  in  flight 

3 

4 

Only  entered  for  commission 

4 

4 

Not  career  relevent 

7 

4 

Felt  lack  of  skill 

4 

4 

1 

Family  pressures 

2 

Ctxiscientious  objector 

1 

Threat  of  draft 

2 

Reduce  service  commitment 

3 

Discemtent  with  Air  Force 

1 

UPT  is  depressing 

1 

Felt  lack  of  dedication 

2 

Total 

89 

90 

4 

^tlie  poftion  of  the  key  developed  on  Criterion  6  (p  ^ 
.04  and  ^  .21)  made  up  of  only  emsting  Air  Force 
OBI  and  FBI  items  was  correlated  with  die  11  criteria 
within  the  cross  validation  sample.  The  number  of  items 
in  this  subkey  was  61  as  compared  to  151  items  in  the 
total  key  built  tv  predict  Criterion  6. 

* 'Significant  beyond  the  .01  level. 


Table  10  presents  the  intercorrelations  of  the 
key  scores  obtained  under  Strategy  B(p>.05  and 
rjjj,  >  .24).  Again,  the  intercorrelations  of  the  four 
key  scores  developed  against  the  external  criteria 
were  aD  quite  hi^,  ranging  from  .92  to  .99.  These 
key  scores  also  correlated  quite  hi^y  with  the 
key  score  buflt  to  predict  Self-Rated  Lack  of 
Dedication  to  Complete  UPT.  These  inteicorrela- 
tions  range  from  .87  to  .93.  The  keys  built  to 
predict  Criteria  1,  3,  6,  7,  and  8  all  correlated 
negatively  and  highly  with  the  key  budt  to  predict 
the  Activities  Index  Factor  Score  on  Motivation. 
Scaling  differences  lesulted  in  these  negative 
correlations  since  the  higli  score  on  Criterion  9 
indicated  a  hi^  level  of  motivation  whQe  high 
scores  on  the  other  criteria  indicated  either  a  low 
level  of  dedication  to  complete  UPT  or  that  one 
had  dropped  out  of  training. 

Table  11  presents  a  set  of  cross  validities 
obtained  in  predicting  the  11  criteria  from  a 


subscore  of  the  key  buQt  under  Strata  A  to 
predict  Criterion  6.  This  subscore  was  crxistructed 
and  modified  tc  conform  with  the  needed  i-  m 
format  from  192  existing  items,  ct^ectively  drawn 
from  the  Air  Force  Officer  Biographical  Inventory 
(OBI)  and  Not  Biographical  Inventory  (PBO-  This 
subscore  for  Criterion  6  from  only  these  official 
Air  Force  items  was  made  up  of  61  items  from  the 
total  Criterion  6  key.  It  should  be  noted  that  the 
decrease  in  validity  in  using  this  subscore  ranged 
from  .03  to  .09.  More  importantly  however,  these 
validities  indicate  what  may  be  obtained  at  present 
in  using  the  items  presently  operational  in  the  Air 
Force  astern  if  they  are  scored  for  motivation. 

If  this  potential  screening  instrument  is  sensi¬ 
tive  to  some  of  the  other  kinds  of  dropouts  or 
eliminations,  a  larger  net  gain  would  be  expected 
tc  result  from  its  use.  A  motivation  assessment 
instrument  should  be  able  to  identify  at  least  a 
portion  of  the  eliminations  in  the  other  attrition 
categories  as  well  as  the  primary  SIE  category. 

SidKat^orization  of  UPT-SIE 

Table  12  represents  an  attempt  to  categorize 
UFT-SIEs  based  upon  the  {4iase  of  training  in 
which  elimination  took  place  and  the  reason,  as 
determined  from  an  examination  of  Faculty  Board 
Proceedings,  for  dropping  out  of  training.  The 
UPT-S!Es  used  in  this  analysis  yield  a  total  number 
of  183.  The  reason  for  the  discrepancy  between 


this  total  and  the  total  number  of  SlEs  reported 
previously  is  that  these  SlEs  were  accumulated 
after  the  earlier  data  processing  had  been  com¬ 
pleted,  and  it  was  felt  that  larger  numbers  would 
represent  a  truer  sample  of  the  UPT-SIE  attrition 
group. 

The  successive  phases  of  tlie  UPT  program  are 
represented  by  T-41,  T-37,  and  T-38  columns  in 
Table  12.  The  indication  was  that  nearly  ah 
trair  ,es  dropped  out  in  either  ‘he  T-41  or  the  T-37 
phase  of  training,  and  the  dropout  split  appears  to 
be  rather  even  between  these  iwo  phases.  The  veiy 
low  frequency  in  dropouts  'vhich  occurred  in  the 
T-38  phase  suggests  that  such  later  dropouts  would 
be  highly  unpredictable  and  perhaps  not  worth 
investigating.  The  reasons  for  dropping  out  of 
training  as  listed  down  the  rows  seem  to  be 
reasonably  consistent  across  the  T-41  or  T-37 
pha.ses  of  training  in  whidi  the  dropout  occurred. 
No  tests  of  significance  were  applied  to  these  data 
since  they  represent  an  incomplete  stage  of  the 
criterion  anafysis  and  served  only  to  suggest  a 
possible  differential  nature  of  dropping  out  of 
training  as  dependent  upon  the  phase  of  training  in 
vidiich  the  dropout  occurred. 


Vt.  DISCUSSION 
Criterion  iVobiem 

The  criterion  problem  in  the  present  study  is 
seen  to  be  an  exceedingly  important  factor  both  in 
determining  the  expected  again  in  percenu^^e  of 
those  completing  UPT  as  a  result  of  uang  the 
predictors,  and  in  obtaining  a  better  understanding 
of  th>:  antecedents  of  attrition  from  Air  Force 
training  programs.  In  estimating  the  expected  gain 
in  UPT  compktior ,  a  prime  consderation  involved 
finding  the  best  c  Iterion  itKasure  upon  which  to 
build  valid  and  staMe  keys  for  selection  purposes. 
While  attention  was  primarily  focused  upon  the 
criterion  measure  buflt  to  contrast  the  UPT-SIE 
attrition  grcip  with  the  success  group,  three 
divergent  app:  ac’ies  appeared  to  be  worthy  of 
conrideratioiL 

Should  the  UPT-SIE  attrition  group  as  a  wln^e 
simply  be  contrasted  with  the  success  group  to 
form  the  primary  UPT-SIE  criterion*’  '  .condly, 
should  criterion  measures  be  compose j  of  two  or 
more  attrition  groups  contrasted  with  a  success 
group?  Thirdly,  should  subcategories  of  the  UPT- 
SIE  group,  which  might  be  expected  to  be  of 
greater  homogeneity  on  some  dimensons,  each  be 
contrasted  separately  with  the  success  group? 


Progress  to  date  has  not  allowed  a  complete 
answer  to  these  conplex  questions.  Nonetheless, 
some  possil^ities  have  been  suggested.  Table  7, 
which  presents  the  cross  validities  obtained 
through  Strategy  A,  indicates  that  in  two  out  of 
the  four  possible  cases,  keys  built  against  criteria 
other  than  the  primary  UPT-SIE  criterion,  and 
which  combined  two  or  more  attrition  groups  in 
contrast  to  a  success  group,  cross  validated  against 
the  primary  UPT-SIE  criterion  at  levels  equal  to 
that  of  the  key  speciflcally  constructed  to  predict 
the  primary  UPT-SIE  criterion.  Interestingly 
enou^,  greater  key  length  could  have  been  a 
factor  in  only  one  of  these  two  keys,  rince  one  kc^ 
was  actually  shorter  than  the  key  buOt  against  the 
primary  UPT-SIE  criterion. 

Table  9,  which  presents  the  cross  validities 
obtained  throu^  Strategy  B,  yields  an  even  more 
striking  pattern.  In  four  of  the  five  posable  cases, 
cross  validities  of  keys  built  against  criteria  other 
than  the  primary  UPT-SIE  criterion  and  which 
combined  two  or  more  attrition  groups  in  contrast 
to  a  success  group  were  equivalent  or  even  better 
predictors  of  the  primary  UPT-SIE  criterion  than 
its  own  key  was.  Hence,  across  botli  Strategy  A 
and  Strategy  B,  66  percent  of  the  keys  built 
against  criteria  other  than  the  primary  UPT-SIE 
criterion  and  which  contrasted  more  than  two 
groups  were  at  least  as  valid  in  predicting  the 
primary  UPT-SIE  criterion  as  its  own  key.  This 
finding  suggests  that  building  keys  against  a  variety 
of  criteria  is  a  sound  approach  which  may  lead  to 
increased  success  in  predicting  the  primary  UPT- 
SIE  criterion. 

4n  alternate  strategy  for  examining  the  charac¬ 
teristics  of  the  criteria  is  to  consider  the  relative 
effectiveness  of  predictors  across  all  criteria.  It 
may  be  noted  that  within  both  strategies  of  item 
keying  used,  the  keys  built  against  Criterion  6 
(OTS-SIE  =  2;  UPT-SIE  =  1;  success  =  0;  other= 
blank)  were  the  most  valid  keys  across  aD  eleven  of 
the  criteria  studied  to  date.  In  fact,  the  keys  built 
against  Criterion  6  were  the  only  key.c  to  produce 
significant  validities  against  dl  seven  external 
criteria  under  both  Strategy  A  and  Strata  B. 
These  results  indic:>!c  that  keys  built  against 
criteria  other  than  the  primary  UPT-SIE  criterion 
were  generaDy  as  valid  as  or  were  more  valid  tlran 
the  primary  UPT-SIE  criterion  key  both  in 
predicting  the  primary  UPT-SIE  criterion  and  irt 
predicting  all  other  criteria. 

The  sample  size  has  not  yet  been  large  enough 
to  ascertain  the  merit  of  predicting  membenhip  in 
different  subcategories  of  the  UPT-SIE  attrition 


I 

j 


group.  The  result  of  what  has  been  done  so  far  in 
approaching  this  problem  was  presented  in  Table 
12  of  the  results  section  and  was  restricted  to 
determining  the  frequency  of  membership  in  two 
sets  of  independent  dimensi>^ns  of  UPT-SIE, 
namely  phase  of  training  in  whidt  dropout 
occurred  and  primary  reason  for  dropping  out. 
Because  of  the  small  sample  sizes,  even  the  most 
cursory  glance  at  Table  12  underlines  the  futflity 
of  attempting  to  predict  who  may  drop  out  of 
training  during  the  T-38  phase,  or  who  may  drop 
out  of  training  for  any  reason  other  than  the  first 
four  listed,  that  Ls  to  say,  dislike  of  flying,  no 
desire  to  fly,  apprehenaon,  or  tension. 

Qosely  related  to  the  problem  of  predicting 
low  probability  behavior,  such  as  dropping  out 
during  the  T-38  phase  of  UPT,  is  the  more  general 
problem  of  base  rates.  Base  rates  in  this  study  refer 
to  the  percentage  of  persons  who  dropped  out  of 
training  and  were  placed  in  a  specific  administra¬ 
tive  category  or  set  of  categories  which  was  then 
contrasted  to  the  success  group  form  a  criterion 
measiie.  The  total  number  of  subjects  from  whom 
the  percentage  was  calculated  included  only  those 
who  were  given  scores  of  either  0,  1,  or  2  on  eadi 
criterion  measure. 

These  base  rates  place  limitations  upon  the 
obtainable  validities  in  predicting  sucass  versus 
faOurc  in  a  specified  criterion  group.  This  limita¬ 
tion  is  due  to  the  nature  of  the  appre^riate 
statistic  for  desaibing  the  correlation  between  a 
dichotomous  variable  with  an  assumed  underlying 
continuous  distribution  and  another  continuously 
dbtributed  set  of  scores.  The  general  rule  is  that  as 
the  base  rate  deviates  from  50  percent  in  either 
direction,  the  maximum  obtainable  validity 
deaeases.  In  fact,  the  maximum  obtainable  cross 
validity  for  a  point-bisertal  correlation  is  .80  when 
the  base  rate  is  50  oercent,  .-  '  as  the  base  rate 
deviates  toward  0  or  1.0,  the  maximum  possible 
validity  approaches  and  finally  reaches  0.  Rather 
than  using  the  typical  maximum  of  1.00  to  depict 
perfectio.n,  the  ^aracteristics  of  the  point-biscrial 
suggest  that  the  index  of  perfection  in  prediction 
varies  with  the  percentage  of  dropouts. 

The  antecedents  and  motivational  components 
of  attrition  from  Air  Force  training  programs  can 
be  examined  by  consdering  the  predictors  which 
produce  significant  validities  against  the  seven 
external  criteria.  This  ^ould  also  include  the 
external  criteria  since  they  could  be  construed  as 
predictors.  The  simple  Self-Rated  Lack  of  Dedica¬ 
tion  to  Complete  UPT  was  significantly  valid  in 
predicting  six  of  the  seven  external  criteria  (Table 
6).  Since  the  flying  deficiency  criterion  was  not 


predictable,  the  suggestion  was  that  being  elim¬ 
inated  for  flying  deficiency  was  not  as  subject  to 
moiivadon  or  dedication  to  complete  the  training 
program  as  were  the  other  extern^  criteria. 

The  Activities  Index  Factory  Score  on  Motiva¬ 
tion  produced  a  validity  significant  beycxid  t!.e  .01 
level  in  predicting  Criteritm  6.  However,  it  w  .s  not 
significantly  related  to  the  primary  UPT-SIE  criter¬ 
ion.  As  may  be  recalled.  Criterion  6  was  a  trichoto- 
mous  SIE  criterion  constructed  specifically  to 
reflect  an  underlying  motivational  continuum.  The 
relationship  between  this  criterion  and  the 
Activities  Index  Factor  Score  on  Motivation  seems 
to  substantiate,  indirectly,  and  to  at  least  a  small 
degree,  both  the  assumption  of  the  underlying 
motivational  continuum  and  the  meaningfulness  of 
the  Activities  Index  Factor  Score  on  Motivation. 


The  above  discussion  of  the  criterion  problem 
casts  a  suspicious  light  upon  any  procedure  which 
avoids  a  comprehensive  examination  of  various 
criterion  measures  by  centering  its  efforts 
exclusively  upon  the  primary  UPT-SIE  criterion. 
This  is  especially  true  when  the  desired  end 
product  is  a  motivationai  predictor  of  useful 
generality  across  a  variety  of  Air  Force  training 
prr^rams. 

Rredktioii 

Predictors  may  be  examined  for  at  hast  two 
reascHis.  The  primary  reason  is  to  determine  at 
what  level  a  predictor  is  related  to  a  ^en  criterion 
or  to  a  set  of  criteria.  In  this  sense,  the  predictor  is 
being  examined  primarily  as  a  means  lo  forecast 
how  one  may  score  on  a  criterion  measure,  or  in 
the  case  of  this  study,  whether  or  not  a  trainee 
would  complete  a  certain  training  program. 

A  second  reason  for  examining  predictor- 
criterion  relationshqrs  is  to  be  able  to  describe  how 
conceptualized  dimensions  are  related  to  member¬ 
ship  in  various  attrition  categories.  The  a  priori 
scores,  both  from  the  Activities  Index  and  from 
the  BI,  were  useful  primarily  in  assigning  meaning 
to  criterion  measures  and  also  to  empirically 
constructed  predictors.  The  use  of  the  a  priori 
scores,  asde  from  atta  .ing  a  little  meaning,  did 
not  result  in  accounting  for  much  variance  in  any 
of  the  criterion  measures.  The  largest  validity 
obtained  against  the  primar>'  UPT-SIE  criterion 
from  any  a  priori  score  was  .18  in  the  case  of  the 
Hann  Avoidance  Need  Score.  Sudi  a  correlation 
can  be  interpreted  to  mean  that  only  about  3 
percent  of  the  variance  on  the  primary  UPT-SIE 
criterion  had  been  accounted  for  by  one's  willing¬ 
ness  to  take  risks.  While  approximately  one-fourth 
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of  the  a  priori  scores  had  significant  validities 
against  the  external  criteria,  they  did  not  exhibit 
high  relationdi^s.  Therefore,  any  attempt  to 
describe  a  typical  dropout  from  the  a  priori  scores 
must  be  tempered  by  the  comment  that  the  rela¬ 
tionships  were  often  very  slight,  so  that  one  is 
careful  not  to  attach  too  much  sgnificance  to  such 
a  dexription.  Keeping  this  in  mind,  the  typical 
dropout  tended  to  be  less  motivated,  less  ener¬ 
getic,  less  bold,  less  likely  to  take  risks,  m^re 
dependent,  and  less  creative  than  those  who 
managed  to  complete  training.  Further  examina¬ 
tion  is  needed  in  relating  the  a  priori  %coks  to  the 
empirically  derived  key  scores  and  in  analy7ing  the 
meaning  of  the  empirical  keys. 

In  the  case  of  the  most  predictable  criterion, 
the  empirically  derived  key  scores  accounted  for  as 
much  as  six  times  more  criterion  variance  than  did 
the  best  a  priori  score.  These  empirically  keyed 
predictors  far  surpassed  the  s  priori  scores  in 
accounting  for  criterion  variance.  .A  systematic  and 
thorough  approach  to  understanding  criterion 
variance  throu^  understanding  the  dimensionality 
of  the  empirically  derived  key  scores  has  received 
only  parti^  attention  thus  far  in  the  data  analysis. 

Table  7  indicates  that  aD  six  of  the  keys 
developed  under  Strategy  A  were  correlated  with 
the  Activities  Index  Factor  Score  on  Motivation 
beyond  the  .01  level  of  significance.  These  correla¬ 
tions  tanged  in  the  meaningful  direction  from 
-.35  to  -.46,  indicating  a  heavy  motr/ational 
component  was  present  in  each  of  the  keys 
developed  under  Strata  A.  The  same  ax  keys 
correlated  with  the  internal  criterion  of  Self-Rated 
Lack  of  Dedication  to  Complete  UPT  between 
+.38  and  +.71.  Again,  this  was  another  indicator 
that  these  keys  were  tapping  motivational 
components  whidi  were  related  to  completion  of 
UPTandOTS. 

A  similar  pattern  was  found  in  Strateg>'  B  as 
even  higher  relationships  were  obtained  between 
the  internal  criteria  and  the  keys  constructed  to 
predict  the  external  criteria  (Table  9).  The  indica- 
timi  was  that  a  heavy  motivational  component  was 
present  in  the  empirically  derived  keys.  Tabic  9 
also  reveals  the  strength  of  building  keys  against 
internal  criteria  and  then  relating  them  to  various 
external  criteria.  Althou^  neither  the  Activities 
Index  Factor  Score  on  Motivation  nor  the  Self- 
Rated  Lack  of  Dedication  to  Complete  UPT 
produced  strikin^y  high  correlations  with  the 
primary  UPT-SIE  criterion  (Table  6).  BI  kQ^s  built 
to  parallel  these  two  internal  criteria  were  more 
highly  related  to  the  external  criteria.  While  the 
Activities  Index  Factor  Score  on  Motivation 


produced  a  correlation  of  only  -.06  against  the 
primary  UPT-SIE  criterion,  the  key  built  frOTi  BI 
items  to  predict  thb  factor  score  conelated  -.19 
wiUi  the  primary  UPT-SIE  criterion.  Similarly,  tlie 
Self-Rated  Lack  of  Dedication  to  Complete  UPT 
correlated  +.22  with  the  primary  UPT-SIE  criter¬ 
ion,  while  the  key  built  against  (his  internal 
criterion  correlated  +.30  with  the  primary  UPT- 
SIE  criterion.  This  procedure  served  as  both  a 
bootstrapping  effect  and  a  means  to  supply  further 
meaning  to  criterion  measures  and  empirical  keys 
derived  to  predict  those  criterion  meaaircs. 

One  important  feature  of  trie  validatimi  of  the 
various  predictors  and  the  analysis  of  the  criterion 
problem  taken  together  was  the  performance  of 
the  keys  built  to  predict  Criterion  6  and  the  rela¬ 
tionships  of  Criterion  6  to  the  various  other 
measures  used  in  the  project.  Both  the  predicta¬ 
bility  of  Criterion  6  and  the  validity  of  the  keys 
buflt  to  predict  it  suggested  that  the  intent  of 
building  a  criterion  with  an  underlying  motiva¬ 
tional  continuum  had  been  approached  and  that 
keys  built  to  predict  it  woulo  also  possess  a 
motivational  component. 

All  correlations  for  the  luolivation  assessment 
instmmem  are  based  on  students  already  in  the 
training  program  rather  than  on  all  initial  appli¬ 
cants  or  all  qualified  applicants  wmich  would 
include  the  unselccted  group. 

Individuals  who  are  in  the  training  program 
have  already  been  screened  to  the  greatest  extent 
possible.  They  have  been  given  very  intensive 
physkal  and  aptitude  examinatiorts  which  were 
the  result  of  many  years  of  study  and  evalnaticm 
by  the  Air  Force.  For  e.xample,  the  yearly  total  of 
applications  for  pilot  training  would  make  a  stack 
of  paper  seven  feet  hi^.  Of  20,000  applicants  who 
qualify  initially,  selection  boards  can  accept  only 
one  in  four  (Mason,  1%7).  Consequently,  only  the 
very  best  “crcam-of-the<rop'"  applicants  arc 
selected  to  enter  the  pflot  training  program.  It  is 
with  these  individuals-a  sample  m  which  the 
variance  has  been  extremely  reduced-that  the 
motivation  screening  was  developed. 

The  magnitude  of  the  correlations  for  the 
motivation  instrument  becomes  even  more 
impresave  when  wwed  a^inst  the  most  recently 
reported  (Mfller,  1%9;  AFOQT  Manual  AF  PT 
901,  1969)  rdationship  between  the  AFOQT  Riot 
Composite  and  success  in  UPT  for  OTS  students  in 
Table  13. 

in  this  table,  all  of  the  correlations  of  the 
AFOQT  scores  with  the  binary  criterion  measures 
of  attrition  arc  biscrial  correlations  which  arc  not 
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Table  13.  Relationships  Batween  AFOQT 
Composites  ami  Success  in  Under¬ 
graduate  Pilot  Training  for  OTS 
Students* 


Criterion 

Corretation 

OTfloer 
Pilot  Quality 

Compoiltc  Compoiite 

Academic  Grade 

.55** 

.48** 

Flying  Grade 

.33** 

.17* 

Military  Grade 

.15 

.20* 

Academic  Elimination 

Flying  Deficiency  Elimination 

.20* 

-.10 

Fear  of  Flying  Emulation 

.10 

-.29 

Self-Initiated  Elimination 

.29 

-.07 

Medical  Elimination 

.26 

.19 

Total  Qimination 

.22* 

-.10 

N 

197 

197 

Elimination  Rate 

.34 

.24 

*Base()  cn  ttudcnt  pilots  trained  in  T-33  airciafc, 
classes  A3A  through  65r>  (Miller,  1969;  AFCX}T  Manual 
AF  FT  901, 1969). 

‘Significant  at  .05  level. 

“Significant  at  .01  les-el. 


directly  influenced  by  base  rates  and  thus  are 
higher  estimates  of  relationships  than  the  more 
conservative  Pearson  correlations  u.<ed  in  reporting 
the  validity  of  the  empirical  keys  in  this  report. 

Validity  Generalization 

During  the  laic'  stages  of  the  project,  an  effort 
tfcill  be  made  to  generalize  keys  constructed  on  the 
OTS  and  UPT  sample.  Tliis  later  stage  of  the 
project  win  be  concerned  with  generalization  and 
wiU  involve  attempts  to  build  keys  on  the 
combined  OTS  and  UPT  sample  which  win  also  be 
successful  against  similar  criteria  in  other  training 
programs,  such  as  Undergraduate  Navigator 
Training,  Undergraduate  Helicopter  Training,  and 
the  Air  Force  Academy.  The  degree  to  which 
dropouts  possess  similar  characteristics  regardless 
of  the  program  which  they  leave  would  determine 
the  success  of  the  validity  generalization. 

One  a^ct  of  validity  generalization  would  be 
to  compare  OTS-SIEs  to  UPT-SlEs.  There  have 
been  some  signs  that  OTS-SIEs  and  UPT-SIEs  arc 
similar.  Adding  the  OTS-SIE  attrition  group  to  the 
UPT-SIE  attrition  group  to  produce  both  dichoto¬ 
mous  and  trichotomous  criteria  resulted  in 
increases  of  validity  for  keys  bufli  across  all  seven 


external  criteria.  By  simply  adding  the  OTS-SIE 
group  and  scoring  both  1,  with  success  as  0,  and 
other  as  blank,  as  in  Criterion  3,  the  increase  in 
validity  over  what  was  achieved  in  Criterion  1 
ranged  from  .04  to  .09.  By  scoring  OTS-SIE  as  2, 
the  UPT-SIE  as  1,  and  success  as  0,  with  other  as 
blank, as  in  Criterion  6,  validities  increased  from  .04 
to  .12.  This  indirect  evidence  indicated  that  UPT- 
SIE  and  OTS-SIE  had  some  factors  in  cwnmon. 

As  a  part  of  the  validity  generalization  some 
more  explicit  attempts  must  be  made  to  compare 
the  common  correlates  of  various  attrition  cate¬ 
gories,  such  as  the  two  SIE  attrition  groups  from 
OTS  and  UPT.  An  examination  of  the  correlations 
between  one  key  developed  specifically  against  the 
primary  smple  dichotomous  UPT-SIE  critedui 
and  another  key  developed  against  a  similar  simple 
dichotomous  OTS-SIE  criterion  would  died 
further  light  on  this  issue. 

Methodological  Censidentions 

The  influence  of  the  research  completed  to  date 
upoi  meth  odological  considerations  c-'"ld  be 
related  to  three  major  factors:  the  number  of 
Items  in  each  key,  standards  for  selection  of  items 
or  keys,  and  the  expected  stabSity  and  validity  of 
empirically  derived  keys.  The  evidence  indicates 
that  an  adequate  number  of  items  for  empirical 
keys  have  been  identified.  The  keys  developed  to 
predict  Criterion  6  under  Strategy  A  consisted  of 
151  items. 

By  taking  less  than  one-half  of  these  items,  or 
the  61  items  which  also  belonged  to  the  Air  Force 
Officer  Biographical  Inventoiy  and  the  Pilot 
Biographical  Inventory,  and  using  these  items  as  a 
subko^  to  correlate  with  aD  the  seven  external 
criterb,  only  slight  drop>  in  validity  resulted.  This 
indicated  that  a  large  number  of  items  would  not 
yield  dramatic  increases  in  validity  although  they 
may  add  to  key  stability.  Keys  of  this  size  ( 1 S I )  or 
even  smaller  have  proved  to  be  the  most  valid  keys 
across  a  number  of  previous  biographical  studies. 

Later  attempts  t»ill  be  made  to  vary  the  number 
of  items  appearing  in  a  key  by  varying  the 
standards  for  item  alternative  selection.  Two 
strategies.  Strategy  A  and  Strategy  B,  were 
reported  in  this  study.  While  Strategy  A  produced 
higher  validities  than  .*'‘ratcgy  B.  some  further 
investigation  into  a  third  strategy,  which  would 
hopefully  result  in  further  increases,  wiU  be 
approached.  Admittedly,  thouglr.  it  is  very  likely 
that  large  increases  in  validity  will  not  result  from 
this  procedure  Perhaps  all  that  can  be  expected 
arc  slight  increases  in  valtd;{y  but  greater  increases 


in  key  stability.  Stability  nu^  certainly  be 
increased  with  a  larger  sample  size  in  further 
analyses.  It  is  importaMt  to  recall  that  the 
maximum  number  of  subjects  used  so  far  has  been 
645  people.  This  number  represents  approximately 
one-fifth  of  all  those  people  on  whom  predictor 
data  will  be  available  for  Battery  A.  The  rest  of  the 
data  win  be  analyzed  after  these  classes  complete 
the  UPT  program,  which  is  approximately  a  one- 
year  program.  Meanwhile,  new  data  are  being 
collected  with  a  revised  predictor  battery. 
Predictor  Battery  B. 

Predictor  Battery  B 

As  a  resi'Jt  of  much  that  has  been  discussed 
here,  the  .«cond  predictor  battery.  Predictor 
Battery  B,  was  developed.  Predictor  Battery  B, 
Flying  Training  Survey  Form  III,  consisted  of  300 
items  which  were  intended  to  make  up  a  se*' 
contained  package  of  items  (te,  one  which  could 
be  used  independently  of  any  other  forms 
developed  in  the  project).  Form  III  included  both 
those  items  from  Battery  A  which  were  found 
valid  in  predicting  external  criteria  and  other  items 
which  were  needed  for  control  purposes  (eg., 
identifreatien  data  and  marital  stams). 

The  second  part  of  Battery  B,  Flying  Training 
Survey  Form  IV,  consisted  of  299  items  which 
have  not  been  used  previoudy  in  this  study.  These 
new  items  were  written  and  selected  on  the  bass 
of  a  number  of  considerations.  Items  were  written 
to  parallel  those  which  had  been  successful  in  he 
first  predictor  batteo^;  other  items  which  had  been 
successful  against  simflar  attrition  criteria  in  other 
studies  were  reused  for  incluson;  and  a  large 
section  of  experimental  forced-choice  items  was 
created.  In  addition,  there  were  items  tapping  the 
student's  perception  of  the  coUege  whi^  he  last 
attended;  a  modified  Guttman  scale  for  measuring 
flying  motivation;  Ghiselli’s  (1964)  adjective 
checklist  which  is  scorable  for  a  number  of  motiva¬ 
tional  variables;  and  finally,  items  reflecting  atti¬ 
tudes  toward  the  mOitary  and  work  in  general.  It  is 
felt  that  a  number  of  these  nc'v  items  wall  reflect 
motivation  toward  achievement  in  the  Air  Force. 

Upcoming  research  effort  wfll  be  placed  upon 
development  of  new  keys  using  predictor  Batteries 
A  and  B.  Keys  buQt  from  Battery  B  will  have  the 
benefit  of  300  additional  items  and  a  substantial 
increase  in  sample  ^e,  both  of  which  could  lead 
.'c  some  increase  in  validity. 

The  second  major  effort  will  be  to  relate 
prqect  findings  to  contemporary  motivational 
theory.  This  will  be  accomplished  through 


examining  item  content  from  valid  k^s  and 
through  examim'ng  relaticndiips  between  the 
various  a  priori  scores  and  the  empirically  derived 
key  scores.  Items  included  in  the  Biographical 
Inventory  and  the  Activities  Index  would  allow  for 
some  evaluation  in  terms  of  Expectancy  Theory, 
Herzberg’s  Two-Factor  Tlieory,  Need  Theory,  and 
McQelland’s  theory  revolving  around  Need  for 
Achievement. 


VIL  CONCXISIONS 

The  following  conclusions  and  recommenda¬ 
tions  should  be  tempered  by  the  fact  that  the  data 
th^  were  based  on  represented  ordy  about  one- 
fifth  of  all  the  people  fbr  whom  predictor  data  on 
Battery  A  wiD  be  analyzed  when  thdr  classes 
(Hnplete  the  UPT  program. 

1.  The  a  priori  scores  f:om  BI  Form  1  and  the 
Activities  Index  at  best  account  for  only  a  very 
small  proportion  of  attrition  criterion  variance. 

2.  It  is  apparent  that  some  motivational 
component  exists  in  the  SIE  attrition  criteria  and 
the  keys  built  to  predict  them. 

3.  Building  keys  against  a  variety  of  attrition 
criteria  may  lead  to  increased  success  in  predicting 
the  primary  UPT-SIE  criterion. 

4.  Cunstmetion  of  BI  keys  against  meaningful 
internal  criteria  can  lead  to  an  increased  under¬ 
standing  of  the  meaning  of  attrition  criteria  and  BI 
keys  built  to  predict  them. 

5.  Low  probabdity  behaviors,  such  as  elimina¬ 
tion  during  the  T-38  phase  of  training  or  dropping 
out  of  UPT  as  a  conscientious  objector,  riiould  not 
receive  major  attention  because  of  the  statistical 
limitations  upon  predicting  such  behavior. 

6.  Because  there  is  considerable  evidence  that 
motivation  is  an  important  underlying  component 
of  a  number  of  criteria,  the  results  so  far  obtained 
suggest  a  wider  range  of  potential  applications 
beyond  predicting  SIE  measures. 

7.  The  AFOQT  already  contairu  valid  items 
that  are  net  now  being  used  but  which  can  be 
scored  for  motivatirm  screening  purposes. 

8.  It  is  now  possible  to  /-oJWf  aH/tUional 
predictor  data  with  the  revised  Ryitig  Training 
Survey  that  resulted  from  an  early  analysis  of  the 
first  available  data  on  attrition. 
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VIIL  tiECOMMENDATlONS 


Althou^  the  AFOQT  is  not  nu\.  being  scored 
for  motivation,  there  seems  to  exist  4'  potential  for 
increased  efficiency  of  piedicting  &lf*Initiated 
Qiminatioii  (S!E).  Empirical  keying  of  AFOQT 
items  and  the  most  valid  items  de/cloped  in  this 


study  yielded  promising  results  as  a  first  step  in 
the  development  of  a  motivation  assessment 
technique.  It  is  recommended  that  further  research 
be  done  to  more  fully  assess  the  impact  of  this 
initial  investigation. 
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